DevOps Engineer
- Full-time
Company Description
About BrightBytes
BrightBytes improves learning for millions of students globally through the use of learning analytics and industry research. The company's flagship product, called Clarity, is an online platform that gives educational leaders everything they need to make faster, better decisions in schools. More than 10% of U.S. schools use Clarity, and hundreds more purchase the platform every week.
The organization is seeking a DevOps Engineer to work in the San Francisco office, a fast-paced, fun, entrepreneurial environment.
About the Founders
Rob Mancabelli, co-founder and CEO, is a recognized education thought leader. He’s the co-author with Will Richardson of the award-winning book, Personal Learning Networks. Hisham Anwar, co-founder and CTO, is an experienced Silicon Valley enterprise technologist who most recently was the head of global technology infrastructure at Zynga Games. Other members of the team include published authors, Ivy-League data scientists, TED-talk speakers, world-class researchers and inspirational education leaders.
Job Description
The DevOps Engineer will work closely with technology, product, development, and data science team members. Position responsibilities will include the following:
Design, develop and deliver the company’s big data infrastructure
Build out data cleansing, analysis, search and reporting pipeline and engine
Define and refine tools to leverage data more effectively for internal as well as client data analysis
Establish and maintain infrastructure specs and run books
Manage resource allocation across all components of the data processing pipeline and infrastructure, including optimizing for spot pricing, Auto Scaling, and more
Create MapReduce jobs and manage scheduling, monitoring and automation
Configure, maintain and deploy relational, NoSQL, column based, document and key-value stores
- Test new technologies and recommend improvements to the pipeline and infrastructure
Qualifications
3+ years experience
Superior coding ability in at least one Java/C++/C#-like language and one Python/Ruby-like language
2+ years experience with commercial cloud services such as Elastic Cloud Compute and Elastic MapReduce
Excellent verbal and written communication skills
Expertise with relational, NoSQL, column based, document and key-value stores
Strong expertise with SQL scripting, data warehousing, business intelligence, and ETL development
Experience with security and Infrastructure as Code solutions
Experience with Agile/Scrum development methodologies
- English language proficiency
Other Desired Skills
Knowledge in MapReduce, Machine Learning, NLP, Complex Event Processing, Text Mining, Semantic Web, Time Series Analysis, Predictive Analytics, and similar
Experience with data mining tools like R and Mahout
Knowledge of search technologies, such as Lucene and Solr
- Practical experience with distributed data analysis systems using parallel processes such as MapReduce, Hadoop, Hive and Pig
Additional Information
All your information will be kept confidential according to EEO guidelines.