Avatar for Insight Engines

Natural language search for Machine Data

Software Engineer – Data Infrastructure

$140k – $165k • 0.04% – 0.06%
Apply now

“The goal is to turn data into information, and information into insight.” – Carly Fiorina

At Insight Engines, we want to end data hoarding. Too much data is overwhelming, but not enough data means missing valuable insights. Our goal is to get the right data into the right structure to turn it into information, then process that information into something accessible to humans, so they can gain insights that weren’t possible before.

But enough about us, let’s talk about you. Do you enjoy optimizing data pipelines and database indexes? How about building scalable data systems with robust monitoring? Have you seen the problems of data overload, and want to help fix them? As an integral member of our technology team, you will engineer, operate, and optimize machine learning models, ETL pipelines, text search engines, OLAP datastores, and everything in between. Your work will enable our groundbreaking natural language platform and help us develop, scale, and deploy our applications in a variety of contexts. You’ll wear many hats, touch many parts of our system, and have a significant impact on our products.

The kinds of problems you’ll be working on include:

  • Indexing and summarizing large data-sets to enable high-performance analytics
  • Optimizing database queries for efficient real-time processing
  • Scaling and maintaining cloud databases and data processing pipelines
  • Developing data-driven APIs for machine learning applications
  • Crafting data normalization models and rules
  • Leveraging existing open source technologies like Kafka, Hadoop, Druid, Spark, PostgreSQL, and other tools
  • When applying, please tell us about your real-world data engineering experience. Women, people of color, minorities, and LGBTQ candidates are encouraged to apply.


  • BS, MS, PhD in Computer Science, Engineering, or related discipline, or 3+ years equivalent technology experience
  • 2+ years of software development (Go, Python, Java, or equivalent)
  • Familiar with complex database management, replication, and backup
  • Operational experience with OLAP datastores, text search engines, key-value stores, or distributed databases.
  • Expertise with writing efficient, complex database queries
  • Secure cloud development experience on AWS, GCP, or equivalent
  • Use engineering best practices – deliver high code quality, automated testing, and build reusable components
  • Authorized to work in the United States
  • New hires must present within 3 days of starting the required documentation proving their ability to legally work in the USA

Company benefits

  • Open vacation policy
  • Health care insurance
  • Dental & vision insurance
  • Life insurance
  • Short-term & long-term disability insurance
  • 401(k)
  • Health care FSA
  • Transit & parking FSA
  • Free lunch at SF office
  • Flexible work hours
  • Holiday time off

Please apply using the following link: https://insightengines.applytojob.com/apply/JMjKPuStqm/Software-Engineer-Data-Infrastructure?source=angellist

Meet your team

People you would work with in this role

Jacob Perkins

Avatar for Jacob Perkins
CTO at Insight Engines, author of Python Text Processing with NLTK Cookbook

Navin Kumar

Avatar for Navin Kumar
@Insight Engines. Former Lead Eng. @Mpact. Founder and Geek. Former CTO of @Socialwok, former Venture Hacker @AngelList

Victor Clark

Avatar for Victor Clark
Security @Insight Engines Georgia Institute of Technology

Grant Wernick

Avatar for Grant Wernick
CEO of Insight Engines. Experienced product focused leader with over 15yrs of experience building amazing teams to create cutting edge natural language tech.

Medical, Dental, & Vision Insurance

Healthcare & Dependent Care FSA

Unlimited PTO

Free lunch provided daily in the SF office

Transit & Parking FSA

+3 more

More jobs at Insight Engines

View all jobs

Python Systems Engineer

Apply now

Senior Frontend Engineer

Apply now

Site Reliability Engineer

Apply now

Senior Product Manager

Apply now

Cloud Service Researcher

Apply now