Databricks
Cloud Data & AIFounded in 2013 by the original creators of Apache Spark, Databricks provides a unified data analytics platform that combines data engineering, data science, and machine learning.
Official Databricks Careers Website
Quick Facts
- Founded
- 2013
- Founders
- Ali Ghodsi, Matei Zaharia & others
- Headquarters
- San Francisco, California
- Industry
- Cloud Data & AI
About Databricks
Databricks was founded in 2013 by the academic researchers from UC Berkeley who originally created Apache Spark, the popular open-source distributed computing framework. The company built a managed platform around Spark to help enterprises process massive datasets in the cloud.
Databricks is widely credited with pioneering the 'Data Lakehouse' architecture, which combines the vast storage capacity of data lakes with the reliability and structure of traditional data warehouses. The company is heavily invested in open-source ecosystems, including MLflow and Delta Lake.
What Databricks Does
Data Engineering
Tools and pipelines for transforming and moving massive datasets reliably.
Data Warehousing
Databricks SQL provides highly performant queries directly on the data lake.
Machine Learning & AI
End-to-end ML environments including model training, tracking (MLflow), and generative AI capabilities.
Data Governance
Unity Catalog offers centralized governance, access control, and auditing across data and AI assets.
Career Areas
Types of professional roles found inside Databricks.
- Software Engineering
- Data Science & AI
- Product Management
- Sales & Go-to-Market
- Customer Success
- Marketing
Databricks's History
- 2013Founded
Databricks is founded by the creators of Apache Spark at UC Berkeley.
- 2018MLflow released
Releases MLflow, an open-source platform for managing the machine learning lifecycle.
- 2020Lakehouse paradigm
Formally introduces the Data Lakehouse architecture, combining data lakes and warehouses.
- 2023MosaicML acquired
Acquires generative AI platform MosaicML for $1.3 billion to accelerate enterprise AI adoption.
Purpose & Values
“To help data teams solve the world's toughest problems”