arch_scribble_Artboard 2.png
UNDER THE HOOD

AT THE CORE

  • Versioned DAG Pipeline

    • Reusable, composable, configurable ‘transform’

    • State & execution management

    • Parallelism, isolation, evolution

    • Automated documentation

  • Built-in Add-on Capabilities

    • Feature export, explorer

    • Search & filtering interface

    • Audit interface

BELLS & WHISTLES

  • Integrations

    • Other compute (pyspark)

    • Scheduling (Airflow), Resource monitoring (Netdata), Services (Supervisor)

    • Unit testing of transforms

  • InterfacesDashboard & APIs

  • Tasks & Services

    • Backup, monitoring, notifications

 
Scribblescribble1