Senior Big Data Engineer job at Turbine

Job Description

Senior Big Data Engineer

WBPlay, a team within Turbine that is responsible for delivering key technology platforms that support games across WB – is seeking a Senior Big Data Engineer to provide hands on development within our Core Analytics Platform team. As a key contributor reporting directly to the Director of Analytics Platform Development, this individual will work closely with developers and dev-ops engineers across multiple teams to build and operate a best-in-class game analytics platform.

The successful candidate will participate in software development and dev-ops projects, using Agile methodologies, to build scalable, reliable technologies and infrastructure for our cross-game data analytics platform. This big data platform powers analytics for WB’s games across multiple networks, devices and operating environments, including Xbox One, PS4, IOS, and Android. This is a role combining proven technical skills in various Big Data ecosystems, with a strong focus on open-source (Apache) software and cloud (AWS) infrastructure.

Our ideal candidate is fluent in several big data technologies - including Hadoop, Spark, MPP databases, and NoSQL databases - and has deep experience in implementation of complex distributed computing environments which ingest, process, and surface hundreds of terabytes of data from dozens of sources, in near real time, for analysis by data scientists and other stakeholders.

Turbine, Inc. is a premier creator and operator of massive, persistent online worlds that foster powerful social gaming communities. Turbine is wholly owned by Warner Brothers Games and has created some of the world’s most popular and award-winning games, including The Lord of the Rings Online™, Dungeons & Dragons Online®, Infinite Crisis®, and our soon to be launched mobile game, Batman Arkham Underworld®.

JOB RESPONSIBILITIES

Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple game franchises.
Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed.
Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members.
Interacts with engineering teams across WB and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
Works directly with business analysts and data scientists to understand and support their usecases

JOB REQUIREMENTS

5+ years of experience coding in Java, Python, or Scala, with solid CS fundamentals including data structure and algorithm design
4+ years contributing to R&D and production deployments of large backend data processing and analysis systems
3+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra.
3+ years of experience standing up and automating the deployment of solutions in AWS using the AWS CLI, with a focus on EMR, EC2, S3, EBS, Redshift, Dynamo, VPCs
Knowledge of SQL and MPP databases (e.g. Vertica, Netezza, Greenplum, Aster Data)
Knowledge of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
Experience participating in an Agile software development team, e.g. SCRUM
Experience designing, documenting, and defending designs for key components in large distributed computing systems
A consistent track record of delivering exceptionally high quality software on large, complex, cross-functional projects
Demonstrated ability to learn new technologies quickly and independently
Demonstrated ability to achieve stretch goals in a very innovative and fast paced environment
Ability to handle multiple competing priorities in a fast-paced environment
Excellent verbal and written communication skills, especially in technical communications
Strong inter-personal skills and a desire to work collaboratively
Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred.
Experience with supporting data scientists and complex statistical usecases highly desirable
Experience as a gamer or strong interest in the gaming industry a plus!

Interested in this position?

Click here to learn how to get in touch