Rarefied talent in data science, data technology, and analytics

Software Engineer - Analytics Infrastructure


Job Description

Twitter is looking for great engineers to build the next generation of tools for working with big data. You have a passion for building massively scalable data-crunching systems wrapped in elegant, easy to use APIs. You will tackle problems involved in processing, coordinating, and organizing hundreds of Petabytes of data spread across multiple compute clusters and data centers. You will build systems that are on the cutting edge of 'big data' infrastructure. You will open-source a lot of your work (examples of our OSS creations include Ambrose, Parquet, and Scalding). You will be relied on by dozens of engineering teams, hundreds of co-workers, and many millions of users.

  • Improve the scalability, resilience, observability, and efficiency of our core systems
  • Create new data processing systems as necessary
  • Build tools to simplify and automate large-scale data management and analysis
  • Build storage systems, libraries, and frameworks that let Twitter grow
  • Cooperate with other teams and contribute to the open-source community


  • BS, MS, or PhD in Computer Science or equivalent work experience
  • Excellent knowledge of in C++, Java, Scala, or other modern systems language
  • Great debugging and reasoning skills


  • Experience with distributed systems, database internals, optimizers, or performance analysis
  • Familiarity and/or history of contributions to Apache Pig, Apache Hive, or similar frameworks
  • Familiar with Cassandra, HBase, Hadoop, and related technologies
  • Demonstrated contributions to open-source software
  • Active user of Twitter
Interested in this position?
Job Location
1355 Market St, Suite 900
San Francisco, CA 94103
Additional Job Details
Employment Type:
Full Time