SE Radio 620: Parker Selbert and Shannon Selbert on Robust Job Processing in Elixir

PostgreSQL Choice

Parker Selbert explains why PostgreSQL is the preferred database in the Elixir community, highlighting its robust features like skip locked and built-in pub/sub capabilities. He emphasizes that PostgreSQL's versatility makes it an ideal choice for applications requiring reliable job processing, as it supports complex data types and operations without needing additional tools 1. Shannon Selbert adds that PostgreSQL's JSON support and version 12 features are crucial for maintaining consistency and reliability in job processing systems 2.

PostgreSQL is by far the favorite tool for Elixir applications, much more than MySQL.

--- Parker Selbert

This preference is further supported by the ability to run tests on multiple database engines, ensuring flexibility and abstraction in Oban's design.

   

Key Features

The Selberts discuss specific PostgreSQL features that enhance job processing, such as partitioning and auto-vacuuming, which help manage database bloat and improve query performance 3. Parker highlights how partitioning allows for efficient data management by splitting tables based on job states, facilitating faster queries and reducing CPU load. Shannon notes that these features are integral to Oban's robust job processing capabilities, ensuring reliability and consistency across distributed systems 4.

Partitioning is a feature of PostgreSQL that lets you have like inheritance in tables and you can split it based on some term.

--- Parker Selbert

These capabilities make PostgreSQL an indispensable component of the Elixir ecosystem.