> ## Documentation Index
> Fetch the complete documentation index at: https://docs.struct.to/llms.txt
> Use this file to discover all available pages before exploring further.

# Getting Started

> Backfill historical Polymarket data and set up realtime streams to keep your database in sync.

## Overview

The Indexing & Backfilling service lets you sync Polymarket data directly into your own infrastructure. Whether you need to backfill historical data or stream updates in realtime, Struct handles the heavy lifting so you can focus on building.

<CardGroup cols={2}>
  <Card title="Historical Backfilling" icon="clock-rotate-left">
    Bulk-load historical markets, trades, positions, and events into your database with a single configuration.
  </Card>

  <Card title="Realtime Streams" icon="bolt">
    Subscribe to Kafka topics for live updates, including new markets, price changes, trades, and settlements as they happen.
  </Card>

  <Card title="Database Sync" icon="database">
    Keep a fully mirrored copy of Polymarket data in your own Postgres, ClickHouse, or other supported databases.
  </Card>

  <Card title="Managed Infrastructure" icon="server">
    Struct manages the indexing pipeline end-to-end, including schema migrations, data validation, and delivery guarantees.
  </Card>
</CardGroup>

## Key Capabilities

* **Kafka Streams**: Connect to managed Kafka topics for low-latency, ordered event delivery. Consume market updates, trades, and order book changes as they occur.
* **Historical Backfilling**: Load the full history of Polymarket data into your database. Backfills run incrementally so you can restart without re-processing.
* **Database Sync**: Struct writes directly to your database, handling schema creation, upserts, and deduplication automatically.
* **Custom Filters**: Scope your data pipeline to specific markets, tags, or event types to reduce noise and storage costs.

## Getting Started

The Indexing & Backfilling service is currently set up on a per-customer basis. To get started, reach out to our team and we'll work with you to configure a pipeline tailored to your needs.

<Steps>
  <Step title="Contact us">
    Get in touch at [support@struct.to](mailto:support@struct.to) to discuss your data requirements and infrastructure setup.
  </Step>

  <Step title="Define your data scope">
    We'll work with you to determine which data types (markets, trades, events, etc.) and filters match your use case.
  </Step>

  <Step title="We configure your pipeline">
    Struct provisions and configures the indexing pipeline, including your database destination, Kafka topics, and backfill schedule.
  </Step>

  <Step title="Go live">
    Once the backfill completes, realtime streaming begins automatically to keep your data up to date.
  </Step>
</Steps>