Senior Software Engineer, Data Engineering Java/Python, Apache Spark

We are open to remote work anywhere in North America

As an Engineer on Lookout's Data Engineering team, you will be working on a platform that processes hundreds of millions of security events daily. You will support real-time analysis in the Lookout Security Cloud, as well as ad hoc analysis by researchers and analysts hunting for new mobile threats. Your datasets will directly support product features such as data dashboards and threat detection. We're looking for engineers who understand both data and infrastructure, and are enthusiastic about working on both.

Do you have good software development skills with Python and Java or Scala? Do you have experience with frameworks such as Apache Spark or Kafka? Then you could be Lookout's next Sr. Software Engineer, Data Engineering with ability to work remotely.

Responsibilities:

• Design, build & maintain reliable systems for storing, transforming, and analyzing large amounts of data using Apache Spark, Apache Airflow, and related technologies
• Manage infrastructure for batch and streaming data processing and data storage, including maintaining CI/CD tooling, system patching and upgrades, monitoring, and performance analysis
• Work with analysts and engineers across the company to meet quality and timeliness goals for data products

Requirements:

• B.S. in Computer Science or related experience
• 5+ years experience designing, implementing, and maintaining complex software systems
• Programming experience in Python, Scala, and/or Java
• Experience with Big Data processing systems such as Spark, Kafka, Airflow, and Storm
• Cloud experience with AWS, GCP, or Azure
• Experience with agile software development, code reviews, git, and task management through tools like Jira.

Desired Skills:

• Experience with ETL workflow & scheduling systems such as Airflow and/or Luigi
• Knowledge of configuration management & deployment using tools such as Ansible, Chef, Puppet or Spinnaker.

About Lookout:

Lookout is an integrated endpoint-to-cloud security company. Our mission is to secure and empower our digital future in a privacy-focused world where mobility and cloud are essential to all we do for work and play. We enable consumers and employees to protect their data, and to securely stay connected without violating their privacy and trust. Lookout is trusted by millions of consumers, the largest enterprises and government agencies, and partners such as AT&T, Verizon, Vodafone, Microsoft, Google, and Apple. Headquartered in San Francisco, Lookout has offices in Amsterdam, Boston, Bangalore, London, Sydney, Tokyo, Toronto and Washington, D.C.

#li-ns1