In production Enterprise data hub
TOPO DataHub: Every system's data, in one data lake.
We build your data hub, new or around the systems you already run. ERP and third-party data, database and file syncs, and web data from public sites, intranets and VPN-only portals all land in one data lake. Collection is read-only, so nothing changes in the source systems, and monitoring and KPI dashboards sit on top.
In production at the distributor we build for, where one data warehouse feeds the reports, TOPO CRM and TOPO Ask.
Built by Kevin Hui and the Top Supplier engineering team
Transcript
- Your numbers are spread out: ERP systems on your own servers, and a service in the cloud.
- We bring them into one data lake in the cloud.
- Inside, data moves through three layers: raw, semantic, and a shared view.
- The on-premise ERP systems are fully refreshed by about seven in the morning.
- The dashboards, CRM and reports we build read from the shared view.
- Each measure is defined in the data lake, not in each report.
- The cloud system updates every hour; same-day sales come in several times a day.
- A health-check script covers every source and flags anything late or missing.
- When we connected a new source, we backfilled 778 days of history, with zero failed loads.
- It runs in production at the distributor we build for. Our engineers can build the same on your systems.
How it works
Four steps, from the systems you run today to the dashboards your team reads.
Connect, read-only
We sync your ERP and other databases, pick up the files your systems export, and collect web data on a schedule with your own accounts. Nothing is written back to the source systems.
One data lake
Everything lands in one data lake, in three layers: raw as each system sends it, then cleaned and named once, then one shared view. Each measure is defined in the data lake, not in each report.
Kept current and checked
Syncs run on a schedule, from every few minutes to once a day. A health-check script covers every source and flags a source that falls behind or a day that is missing.
Dashboards and answers on top
KPI dashboards, management reports, TOPO CRM and AI agents such as TOPO Ask all read the same data lake.
What's in it
What we build, connect and run for you.
ERP and database sync
On-premise ERP databases and a cloud system loaded into one cloud data warehouse: the on-premise ERPs fully refreshed by about 7 am, the open-order book every hour, the cloud source every hour and same-day sales several times a day.
In productionFile sync
Exports land as files on a schedule, with a current file and a dated history for each source, and are loaded into the data lake or into the shared folders and spreadsheets your team already uses.
DeliveredWeb data collection
A specialist team with extensive on-site experience collects web data on a schedule: from public websites, and from intranets and portals reachable only over your VPN, with your own accounts and read-only. It works where a system has no API, and every run is logged.
DeliveredMany systems, one data lake
However scattered your third-party systems are, their data is gathered read-only into one data lake and managed in one place: three layers, from raw to semantic to one shared view, with each measure defined in the data lake, not in each report.
In productionMonitoring and day-to-day data operations
A health-check script covers every source: a source that falls behind, a missing day, late hourly loads. Freshness checks can email your team when a table runs late, and every collection run is logged.
DeliveredKPI dashboards on top
Management reports from one set of numbers, operations KPI dashboards built in the office apps your team already uses, with access to each one managed in one place, and TOPO CRM for field sales.
DeliveredNew hubs, and existing ones re-engineered
We build new data hubs and re-engineer existing databases, and we connect new sources to a hub that is already running, history included.
History, loaded in full
of history backfilled when we connected a new source system to the shared warehouse, with 0 failed loads
1 Jul 2024 – 17 Aug 2026, one source system.
FAQ
Do you change our existing systems?
No. We read from them: database sync with read-only access, the files they already export, and web data collected with your own accounts. Nothing is written back to the source systems.
What if a system has no API?
We collect its data on a schedule from the screens and portals your team already uses, with your own accounts and read-only, including intranets and portals reachable only over your VPN. Every run is logged.
Can you start from the database we already have?
Yes. We build new data hubs and also re-engineer existing databases, and new sources can join a hub that is already running, with their history loaded.
Who reads the data lake?
Your KPI dashboards and reports, TOPO CRM for field sales, and AI agents such as TOPO Ask, which writes a query, runs it on the data lake read-only and answers in your team's WhatsApp group.
How do we know the data arrived?
A health-check script covers every source and flags a source that falls behind, a missing day or late hourly loads. Freshness checks can email your team when a table runs late, and each collector logs every run.
Our data promise
Your servers or your cloud
By default we deploy on your servers or in your own cloud account; we can also host it for you.
Not used to train AI models
For your deployment we use paid AI services whose terms exclude training on your data. For documents that must stay in your building, the AI runs on a GPU server on your premises.
Separate, under NDA
Each client gets a separate database or project, under a confidentiality agreement.
Full handover
When the project ends, the code and data we built for you can be handed over in full.
More TOPO products
-
TOPO OrderSnap
Order intake AI
AI reads customer orders in any format and enters them as complete orders, checked against your rules. Your team reviews each one and sends it with one click.
In production -
TOPO CRM
Field sales on iPhone and web
For reps and their managers: this week against target, customers who have gone quiet, and every customer down to the order line, with visit notes alongside.
In production -
TOPO Ask
Ask in the team's WhatsApp group
An AI agent for questions in plain words: it queries your data warehouse and lays the answer out for a phone. A business briefing arrives at 10:00 each morning.
In production -
TOPO NEXT
Next-generation platform
One path from a customer's PO to the delivery at their door, with a new pricing engine underneath. Ready to demonstrate, tailored to your operation.
Start with the systems you run
Tell us which systems hold your numbers today, including the ones with no API. We will show you how they would land in one data lake and what your team would see on top.