Ibis
Judgement: Assess
Portable Python DataFrame compiling to many backends; trajectory strong, footprint small.
Portable Python DataFrame API that compiles expressions to a backend of choice — DuckDB, BigQuery, Snowflake, Postgres, Spark, and many others.
Lets analytics code be written once and executed against whichever engine the data happens to live on, without rewriting in each backend's SQL dialect.
Why it counts as a standard
Ibis defines a backend-neutral DataFrame expression API, with a published backend protocol that 20+ engines implement. The API and the backend contract are the standard surface — Ibis is the rare project where the standardised "interface" is its whole reason to exist.
At a glance
- Category
- Processing
- Governance
- Ibis Project (open source)
- Status
- Stable; multi-backend
- First released
- 2015
Links
Related standards
Other standards in Processing.
- dbt — data build tool
- Pandas — pandas
- Spark — Apache Spark
- SQL DML — SQL Data Manipulation Language
- Beam — Apache Beam
- XSLT — Extensible Stylesheet Language Transformations
See Ibis in context
Open the interactive Data Landscape to compare Ibis against every other open standard, or grab the raw JSON. Spotted something wrong? Open an issue.