We are looking for graduates, non-graduates, or those seeking a career change who are interested in developing software engineering skills through an immersive "learn on the job" internship program. As an intern, you will be embedded into an engineering team within our Product and Technology departments and assigned a primary project with clear deliverables. Alongside your manager and dedicated mentor, you will learn the inner workings of our open source code that helps to create "a world in which everyone can freely share in the sum of all knowledge". You will work with software that serves over half a billion page views per day through Wikipedia (and other Wikimedia projects). The outcome of your work will impact how all people everywhere discover, share, and contribute to free knowledge.Additionally, you will have the opportunity to learn about various departments at the Foundation and connect with the wider volunteer movement and community.

Applicants who identify from a group that is underrepresented in the global conversation of technology advancement are encouraged to apply. We're also welcoming applicants from communities where access to free knowledge and Wikimedia projects are just emerging.

As we form our internship cohort, we are looking for candidates who possess:

• Basic experience with at least one back end or front end programming language (e.g PHP, Javascript) OR an interest in cybersecurity and/or privacy
• Basic experience with databases
• Basic experience with at least one scripting language
• Ability to work independently and be resourceful in solving problems
• Ability to stay accountable to deliverable requirements deadlines
• Effective and inclusive communication skills with diverse cultural and language communities.
• Willingness to learn, a positive attitude, and empathy
• A sense of curiosity and and hunger to learn
• The ability to flourish in a highly transparent and collaborative environment
• A desire to make meaningful contributions to knowledge equity, free culture, and open access to global education

Summary

The Wikimedia Foundation is looking for a Data Engineer to join our team, reporting to the Director of Data Engineering. As a Data Engineer, you will be responsible for building, maintaining and expanding the shared data infrastructure that powers a big part of decision making in the Foundation as well as the Wiki Movement. This includes everything from building scalable pipelines using big data technology to defining and creating a suite of datasets which adhere to our privacy principles.

You are responsible for:

• Integrating data from multiple sources to gain insights in areas such as content, traffic, editors, readership and fundraising
• Building scalable data pipelines in collaboration with other data engineers as well as teams across the foundation including product analytics, platform engineering, survey, research and machine learning teams
• Designing the shared data platform that supports use cases for critical aspects of the Wikimedia mission: harassment prevention, image classification, bot detection, DDoS attacks flagging and many more
• Building and maintaining public metrics and datasets
• Implementing data quality monitoring that alerts the team of possible data issues
• Implementing a data governance and lineage solution for all Wikimedia data

Skills and Experience:

• 2+ years of relevant industry experience
• Advanced working knowledge of SQL, relational databases, query authoring, ideally in a variety of flavors (in our team alone we deal with MariaDB, HiveQL, CassandraQL, Spark SQL and Presto)
• Experience with one or more programming languages such as Python, Scala, and Java
• Experience building data pipelines using tools such as Airflow, Spark, Gobblin, Oozie, Yarn
• Familiarity with stream processing systems using Kafka, Spark streaming and/or Flink
• Excellent written and verbal communication skills
• Strong interpersonal and collaboration skills
• BS or MS degree, preferably in Computer Science, or equivalent work experience

Qualities that are important to us:

• Commitment to the mission of the organization and our values
• Commitment to our guiding principles
• Commitment to diversity, equity, and inclusion
• Cross-cultural sensitivity and awareness
• Collaborative working experience

Additionally, we'd love it if you have:

• Experience with Hadoop
• Understanding of related disciplines including Machine Learning, Statistics, Privacy and Algorithms
• Experience working with site reliability engineers