Download in Bulk

To unlock local access to the US Futures dataset, open the Pricing page of your organization and subscribe to at least one of the following data packages:

• US Futures Daily History by AlgoSeek
• US Futures Hour History by AlgoSeek
• US Futures Minute History by AlgoSeek
• US Futures Second History by AlgoSeek
• US Futures Tick History by AlgoSeek

You need billing permissions to change the organization's subscriptions.

After you subscribe to local access, follow these steps to download the data:

1. Log in to the Algorithm Lab.
2. On the CLI tab of the dataset listing, use the CLI Command Generator to generate your download command and then copy it.

The Ticker, Start Date, and End Date fields are irrelevant for bulk downloads.

3. Open a terminal in your organization workspace and then run the command from the CLI Command Generator.

After you bulk download the US Futures dataset, new daily updates are available at 7 AM Eastern Time (ET) after each trading day. To unlock local access to the data updates, open the Pricing page of your organization and subscribe to at least one of the following data packages:

• US Futures Daily Updates by AlgoSeek
• US Futures Hour Updates by AlgoSeek
• US Futures Minute Updates by AlgoSeek
• US Futures Second Updates by AlgoSeek
• US Futures Tick Updates by AlgoSeek

You need billing permissions to change the organization's subscriptions.

After you subscribe to dataset updates, to update your local copy of the US Futures dataset, use the CLI Command Generator to generate your download command and then run it in a terminal in your organization workspace. Alternatively, instead of directly calling the lean data download command, you can place a Python script in the data directory of your organization workspace and run it to update your data files. The following example script updates all data resolutions and markets:

import os
from datetime import datetime
from pytz import timezone

# Define a method to download the data
def download_data(market, resolution, overwrite=False):
    print(f"Updating {market} {resolution} data...")
    command = f'lean data download --dataset "US Futures" --data-type "Bulk" --market "{market}" --resolution "{resolution}"'
    if overwrite:
        command += " --overwrite"
    os.system(command)

# Update minute, second, and tick data files
MARKETS = ['CBOT', 'CFE', 'CME', 'COMEX', 'ICE', 'INDIA', 'NYMEX']
END_DATE = datetime.now(timezone("US/Eastern")).strftime("%Y%m%d")
new_data_available = False
for resolution in ["tick", "second", "minute"]:
    for f in os.listdir(f"future/cbot"):
        if f != resolution:
            continue
        latest_date = sorted([f for f in os.listdir(f"future/cbot/{resolution}/zc")])[-1].split('_')[0]
        if latest_date >= END_DATE:
            print(f"{resolution} data is already up to date.")
            continue
        new_data_available = True
        for market in MARKETS:
            download_data(market, resolution)

# Update daily and hourly data files
if new_data_available:
    for resolution in ["hour", "daily"]:
        for market in MARKETS:
            download_data(market, resolution, True)

The preceding script checks the date of the most recent ZC data you have from the CBOT market for tick, second, and minute resolutions. If there is new data available for any of these resolutions, it downloads the new data files and overwrites your hourly and daily files. If you don't intend to download all resolutions and markets, adjust this script to your needs.

The following table shows the size and format of the US Futures dataset for each resolution:

The following table shows the price of the US Futures dataset subscriptions: