Space and Time was designed to join your offchain data loaded in from source systems like Snowflake or Postgres with our indexed data. There are several ways to load data into Space and Time, and you'll want to choose a method depending on the volume, velocity, and frequency of your loading.

Ways you can load your own data

• SxT REST APIs - For inserts, updates, and transactions. This is a great option for when your data is small. For example, your dapp could issue an API request to add (or update, or delete) small amounts of data based on user activity. You can connect directly to the network and insert data to private tables using biscuits with the DML API, or you can connect to the Gateway (Secrets Proxy) via an API key and send insert statements through the standard Proxy SQL API.
• Kakfa streams - For large volume or append-only. Space and Time lets you easily set up your own streams and configure how the data should be ingested.
• JDBC driver - For batch inserts and bulk uploads. You can use the Space and Time JDBC driver to use Space and Time with your favorite BI tools.
• ETL tools - Load your data from any source database using Fivetran, Airbyte, or any ETL tools of your choice.

Sources you can load from

• Bulk load data from cloud object storage (like AWS, S3, or Azure blob).
• Load from HDFS/Hadoop/Hive
• Insert or stream from gaming servers
• Insert or stream from gaming platforms like Playfab
• Stream from TradFi markets
• Space and Time provides blockchain indexing as a service, so blockchain data is readily available in the platform.

Note about table authorization

Keep in mind that writing to tables requires permissions, which is handled using biscuit authorization. When you connect to the Gateway (Secrets Proxy), resources and permissions created and biscuits uploaded to the Gateway will automatically be provided to the SxT Network to authorize your request on your behalf. You can also provide biscuits manually as part of the request body and they will be forwarded to the SxT Network.

When you connect directly to the network, the DML API requires explicit configuration of biscuits. To learn more about creating and managing biscuits, see this section.