Analytics Overview
The Pixlr Group analytics infrastructure unifies data from both Pixlr and Designs.ai products, enabling data-driven decision making across the organization.
Architecture Overview
Our analytics stack consists of three main components:
- Data Ingestion: Airbyte (self-hosted on AWS)
- Data Warehouse: ClickHouse (hosted service)
- Data Transformation: SQLMesh (CI/CD pipeline)
Products Covered
Pixlr
- Source Database: MongoDB
- Admin Integration: Existing admin area connects to ClickHouse
Designs.ai
- Source Database: MySQL
- Admin Integration: Planned for future implementation
Data Flow
Key Benefits
- Unified Data View: Single source of truth for analytics across all products
- Team Collaboration: Reunifies Dev team and BI team (Caleb) workflows
- Cost Effective: Self-hosted Airbyte + hosted ClickHouse for optimal cost/management balance
- Scalable: ClickHouse scales automatically, no infrastructure management needed
Tools Overview
- Airbyte - Self-hosted data ingestion on AWS
- ClickHouse - Hosted data warehouse service
- SQLMesh - CI/CD data transformation pipeline