Agentic crawler
Open NewsCrawler to collect and extract news content. Use its API documentation to connect data collection to agents and research workflows.
Collect, organise and work with research data. Your starting point for agentic crawlers, the data warehouse and automated workflows.
Collection, storage and orchestration
Open NewsCrawler to collect and extract news content. Use its API documentation to connect data collection to agents and research workflows.
Browse the research data repository and organise datasets with metadata. Sign in to manage deposits and access restricted datasets.
Browse the original news and social-media collections, search records, filter dates and export CSV samples. This is the existing crawler database, separate from Dataverse.
Sign in with your Airflow account. Read-only access; source records are not moved, changed or published.
158.182.35.1065433airflowSQL client credentials are provided separately by the administrator. The explorer uses its own restricted read-only database account.
Schedule collection jobs, coordinate data pipelines and review workflow runs in Apache Airflow.
Sign in to the workflow console. Legacy collection jobs have not been reactivated; the initial connectivity-check workflow is manual-only.
Service availability was checked on 20 October 2026. This page provides service entry points; it does not monitor live availability or automatically transfer data between services.