Skip to main content

Analytics Overview

The Pixlr Group analytics infrastructure unifies data from both Pixlr and Designs.ai products, enabling data-driven decision making across the organization.

Architecture Overview

Our analytics stack consists of three main components:

  1. Data Ingestion: Airbyte (self-hosted on AWS)
  2. Data Warehouse: ClickHouse (hosted service)
  3. Data Transformation: SQLMesh (CI/CD pipeline)

Products Covered

Pixlr

  • Source Database: MongoDB
  • Admin Integration: Existing admin area connects to ClickHouse

Designs.ai

  • Source Database: MySQL
  • Admin Integration: Planned for future implementation

Data Flow

Key Benefits

  • Unified Data View: Single source of truth for analytics across all products
  • Team Collaboration: Reunifies Dev team and BI team (Caleb) workflows
  • Cost Effective: Self-hosted Airbyte + hosted ClickHouse for optimal cost/management balance
  • Scalable: ClickHouse scales automatically, no infrastructure management needed

Tools Overview

  • Airbyte - Self-hosted data ingestion on AWS
  • ClickHouse - Hosted data warehouse service
  • SQLMesh - CI/CD data transformation pipeline