Job Description
GumGum's Data Engineer builds and maintains distributed systems, services and data pipelines. The role is focused on working on complex distributed systems, the performance of these systems and the ongoing optimization in service of our core business. This role is required to write highly scalable and fault tolerant code within company adopted technologies.
Reporting to our Data Engineering Manager, this role works as part of a team of engineers in the technology division of our advertising business.
Technologies Used By GumGum
- For Distributed Data processing: Kafka, Spark/Spark-Streaming on Databricks, Druid
- For Data warehousing and reporting: AWS redshift, AWS Athena, Snowflake, Superset and Looker
- For Data Pipelining: Apache Airflow, AWS Data Pipeline
- In addition to above, additional technologies currently adopted: Groovy, docker, AWS ECS, DynamoDB, RDS
Please note that this is a remote work (work from home) opportunity. You will work closely with another engineer located in India (also working remotely) as well the team in California.
Responsibilities
- Must do minimum 2 hours of overlap with California business hours. Usually it's 9.30 pm to 11.30 pm in India.
- Create and maintain optimal data pipeline architecture with Apache Kafka, Apache Spark, Apache Druid and Snowflake for real-time analytics
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark on Databricks, Apache Airflow and AWS 'big data' technologies like AWS Glue, AWS Athena.
- Participate in technical discussions, code reviews, help the team in implementing engineering best practices.
- Work on GumGum's proprietary Reporting Server API and on various reports using Groovy, SQL and Java
- Work on GumGum's proprietary time-series forecasting systems infrastructure in spark on databricks and data pipelines in airflow
- Work as part of the engineering team, supporting key projects and providing tactical recommendations for improving and helping the team to be efficient at scale
Minimum Qualifications
- 1+ year of experience in data engineering and warehousing
- 1+ year of Apache Spark experience in production workloads
- 2+ years of Software Engineering experience (Java/Scala/Python)
- 2+ years of experience in SQL and API Development
- Experience with big data tools: Spark, Kafka, Hadoop, Druid etc.
- Experience with stream-processing systems: Spark-Streaming, Flink etc.
- Familiar with various AWS services, Serverless architecture and containers
- Must be able to write quality code and build secure, highly available systems.
- Excellent problem solving and critical thinking skills
- Strong Verbal and written communication skills
- Can work effectively remotely by utilizing technology tools to stay connected to the distributed team
- Able to explain technical concepts to developers and project managers in a way that they understand and is effective
- Desire to work with a team of people solving complex problems and sharing knowledge freely
- Can execute individually but also operate as part of a distributed team
- Is flexible in approach. Knows there is not one way to solve a problem
- Able to explain technical concepts to developers and project managers in a way that they understand and is effective
- Desire to work with a team of people solving complex problems and sharing knowledge freely
- Can execute individually but also operate as part of a distributed team
- Is flexible in approach. Knows there is not one way to solve a problem and can get to the best solution for GumGum through collaboration without locking in on a personal position
Career & Development Focus
- Ongoing learning and development for education opportunities such as webinars, books, classes, relevant conferences and events
- Opportunities to pursue business related side projects and yearly Hackathon
- Highly encouraged to contribute to open source software, including our own open source software
- Environment of learning from peers, including meetups, presentations and blog posts
- Opportunity to work with cutting edge technology
- Life Skills sessions - geared towards the whole life/ health / person
- Leadership Bites Dinner Series - connecting current and future GumGum leaders over great food and meaningful conversation
- Please note that we are not currently accepting candidates from recruiting agencies or 3rd parties.*
____________________________________________________________
WE INVITE YOU TO LEARN MORE ABOUT GUMGUM!
Our Values…
Be Thoughtful
We listen to understand different perspectives, show everyone respect, and relentlessly seek solutions for our clients (internal and external).
Have Agility
We are quick, nimble, and change direction gracefully, while maintaining control.
Show Grit
We bring energy and perseverance to everything we do.
Our Team…
At GumGum, we innovate. Our two divisions, Advertising and Sports, are powered by expansive, sophisticated AI-driven marketing and analytics solutions. Our vision is clear: We want to use our proprietary technology to solve the hard problems across the media industry. As a company, we celebrate kindness, resilience, the courage to think outside the box and the importance of having fun. All of our internal operations and decisions are undertaken with complete transparency, with a highly accessible executive, leadership team. For GumGummers, we believe in providing all the necessary tools, resources and guidance needed for them to excel. And, they do excel.
Our Tech…
GumGum is constantly evolving to be at the forefront of computer vision and machine learning advancements. With nearly 10 years experience, we use our proprietary image recognition technology to deliver highly engaging, contextually relevant ad experiences across premium publishers all over the world.
Our Products & Services…
Our Advertising business serves contextual marketing messages in line with content users are actively engaged with.
Our Sports business helps marketers and rights holders understand the full media value of their sponsorship investments across broadcast and social media. And we deliver on brand safety by leveraging our AI to detect unsafe text and imagery, allowing us to deliver ads in brand safe, contextually relevant environments.
Our Hackathons…
What's a Hackathon? We're glad you asked. Our employees split into teams and spend 48 hours 'hacking' together before presenting their ideas to our executive team. It's a chance for anyone within our company to showcase the visions they want to bring to fruition.
Our Culture…
GumGum recently earned LA's Best Places to Work Award 2020 and Inc. Magazine's Best Places to work in 2020, and it's no surprise why. With company-sponsored social hours, annual holiday celebrations and on-site gatherings, GumGummers enjoy a fun, creative and collaborative workplace. We provide ourselves on our strong track record of giving employees the autonomy and support they need to succeed.
Oh, and doggies…
We love our dogs so much, we even have an Instagram dedicated to them! Follow us: @dogsofgumgum