DataLens frequently asked questions
What the platform does, which sources it connects to, what it produces, and — just as usefully — what it does not do. Every answer describes the product as it is today.
Getting started
What the platform is, who it is for, and what it takes to begin.
What is DataLens?
DataLens is a platform covering the whole data lifecycle in one place: connecting sources, preparing and cleaning data, modelling it, orchestrating pipelines, analysing it, delivering the result and governing all of it. The navigation follows that order — Data, Prepare, Model, Orchestrate, Analyse, Deliver, Govern — because it is the order the work actually happens in. Instead of stitching six tools together and maintaining the seams, the same datasets flow through each stage.
Who is DataLens for?
Business users, data analysts, data architects, solution architects, data engineers, project teams and students learning data architecture. The interface does not require code for the core work, so an analyst can clean and chart a dataset, while an architect gets source and target models, mappings and lineage on the same data. Generated documents are grouped by persona for that reason — an executive brief and a technical handover describe the same system very differently.
Do I need to write code to use DataLens?
No. Cleaning, transforms, joins, models, mappings and pipelines are all built through the interface. Where SQL is the clearer answer you can use it — database connections have a SQL mode, and models can be generated from SQL — but nothing requires it.
Do I need to be a data architect to use DataLens?
No. The screens are usable without formal training, and the lifecycle order gives you a sensible path through them. That said, the modelling and governance screens reward some understanding of what a fact table or a lineage graph is — which is part of why people use the product to learn those concepts on real data rather than on a textbook example.
What do I need before I can start?
A dataset. Upload a CSV or Excel file, or connect a database, REST API, file server, CRM or data lake — every other screen in the platform works on datasets, so getting one in is the only prerequisite. A file upload takes under a minute.
Can I use DataLens on an existing project?
Yes, and that is the common case. Connect the systems that already exist, load the tables that matter, and build a source model of what is actually there. Nothing needs to be greenfield — most of the value in the modelling and lineage screens comes from documenting a system nobody has documented.
Real use cases
The problems people actually bring to it.
Can DataLens help me understand where data comes from?
Yes. The Lineage tab under Govern shows a graph running from the original source, through every transform applied, to the dataset's current state. Following a column backwards shows exactly where it was cast, split, renamed or derived. It is the difference between defending a number with an opinion and defending it with a trace.
Can I map how data moves between systems?
Yes. Build a source model from the systems you have connected, define the target model you want, and use the Mapping screen to connect source columns to target columns. The most useful output is usually the target columns with nothing mapped to them — each one is a decision that has not been made yet.
Can DataLens help me understand a database structure I did not design?
Yes, and this is one of the strongest uses. Connect the database and you can list every table your credentials can see and preview columns and sample rows without importing anything. Load the tables that matter, build a source model, and you have a readable diagram of a system that previously existed only as DDL.
Can I use DataLens to see what breaks if I change a source system?
Yes — read the lineage graph forwards instead of backwards. It shows what was built from a given source, which is the impact analysis you want before changing or retiring one. It covers what happened inside DataLens; transformations applied upstream are outside its view.
Can I build a Customer 360 view?
Yes. Load the sources — CRM, billing, product database — then either join them into a view, or define a data product with an agreed schema if you want it owned and reusable. The data product route marks each field as mapped, derived, a gap, or missing, so what the view does not yet cover is stated rather than discovered later. Data products are a Pro capability.
Can I use DataLens for learning data architecture?
Yes. Load a real dataset, profile it, model it, trace its lineage and publish it — the concepts become concrete because you are applying them to data rather than reading about them. Connecting an existing database and reverse-engineering its structure is a particularly good exercise.
Features
What each stage of the lifecycle actually does.
What can DataLens do to clean my data?
The Prepare screen offers 22 operations grouped as Filter Rows, Clean, Transform and Derive — dropping and filling nulls, removing duplicates, capping or removing outliers, casting types, splitting and renaming columns, standardising names and values, appending datasets, lookup enrichment, group-by aggregation, and derived columns including z-scores and percentile ranks. Every operation shows a live preview before it is applied.
What kinds of data models can I build?
A source model documenting the structure you have, and a target model describing the structure you want, kept deliberately separate so current state and intended state never get conflated. Tables can be marked as facts or dimensions, relationships recorded, execution order set, and joins designed visually with inner, left, right and outer join types.
Can DataLens detect personal data in my datasets?
Yes. The Keys & PII tab examines actual column values and reports recognised patterns — email addresses, phone numbers, dates, URLs, postcodes and ZIPs, currency, IP addresses and booleans. Detection is by content rather than by column name, so a personal-data column with an innocuous name is still found. It is a signal for a person to act on, not a compliance judgement.
Does DataLens support data quality rules?
Yes, on the Pro tier. Quality Rules turn an expectation into a check that runs rather than an assumption nobody tests, alongside a Dictionary recording each column's business meaning and expected format, and Column Naming for consistent naming across datasets. All three carry a Pro badge in the product.
Can I automate a repeated data process?
Yes. The Pipeline Workbench assembles loads, cleaning, joins and shaping into a pipeline with an explicit execution order, so a process that lived in one person's memory runs as one unit. A step that fails stops the pipeline rather than letting downstream work run against incomplete input.
Can DataLens do what-if analysis?
Yes. Simulate & Decide offers scenario modelling against a target metric, strategy comparison, impact analysis across metrics, forecasting with linear trend, moving average or exponential smoothing, and shock simulation with step, ramp, spike and sustained-pressure shapes. It runs against your own data, and it produces a structured estimate rather than a prediction.
How does DataLens use AI?
AI-assisted features run against a model provider you configure yourself, using your own credentials — you choose which models the connection is allowed to use and which is the default. Usage is observable rather than opaque: AI Operations under Govern reports cost, tokens, failures, cache behaviour and estimate versus actual. Ari, the assistant, is available as a widget on every screen.
Inputs and imports
What can get in, and how.
What file formats can I upload?
CSV, TSV, Excel (.xlsx and .xls), JSON and OpenDocument (.ods). For an Excel workbook, one sheet becomes one dataset. Object storage formats such as Parquet are not accepted by the file upload — those are handled by the Data Lake connector instead.
Which databases can DataLens connect to?
PostgreSQL, MySQL, SQL Server, Redshift, BigQuery and Snowflake. Each has its own connection form with the fields that engine requires, a Test Connection action, and a browser that lists the tables your credentials can see. You can load whole tables or write SQL and load the query result.
Which CRMs can I connect?
Salesforce, HubSpot, Dynamics 365 and Zoho CRM. Each requires an application to be registered on the CRM side — a Connected App in Salesforce, a private app in HubSpot, an app registration for Dynamics 365 — which usually needs administrator rights in that CRM.
Which data lakes and lakehouse engines are supported?
AWS S3, Azure Data Lake Gen2, Google Cloud Storage, Databricks / Delta Lake, Dremio, Starburst / Trino and MinIO. Apache Kafka and Apache Iceberg appear in the connector list marked as not yet available. You can use managed storage or Bring Your Own Lake, where the data stays in storage your organisation owns.
Can I pull data from a REST API?
Yes. Set the method and endpoint, choose the authentication — No Auth, Bearer Token, API Key with a custom header, Basic Auth, or OAuth 2.0 — and use the Data Path field to point at the array of records inside the response. A load returns what one call returns; the connector does not page through a paginated API automatically.
Can DataLens keep a dataset in sync with a source table?
Yes, using CDC Sync. Audit-poll mode is on the free tier, works with PostgreSQL and MySQL, and finds changes using a watermark column such as updated_at on a schedule you set. Log-based capture reads the database change log instead, catches deletes, and does not depend on a watermark — it is Pro and PostgreSQL only.
Can I work with documents rather than tables?
Yes. Document collections store files whole and work on their text, rather than forcing them into rows. Which formats a deployment can read is shown in the Documents panel and comes from the server, typically covering plain text, Markdown, HTML and Word (DOCX).
Can DataLens read PDF documents?
It depends on the deployment. PDF extraction is not enabled in every build, because recovering text from a PDF requires a real PDF engine — a PDF stores glyph positions rather than text. Where extraction is not enabled, a PDF is refused rather than stored with empty content, which is deliberate: a silently empty document is worse than a rejected one. The format table in the Documents panel is the authoritative answer for your deployment.
Outputs and views
What comes out, and in what shape.
What formats can I export data to?
CSV, TSV, JSON, JSONL, Excel (XLSX) and Schema Only, which exports the structure without the rows. JSONL is the one to choose for large machine-consumed exports; Schema Only is more often what an architecture discussion actually needs.
Can I export a data model diagram?
Yes. A model exports as a PNG image, an SVG diagram, SQL DDL, a JSON model or a CSV schema listing. SVG for documents that get resized, PNG for slides, DDL when someone needs to recreate the structure.
Can other systems fetch data from DataLens?
Yes. The API Access section on the Publish screen exposes a dataset as an endpoint, with options to fetch it as JSON or CSV and a JavaScript fetch snippet to copy into an integration. The endpoint serves the dataset as DataLens holds it, not as a live query against your source system.
What charts and analysis views are available?
Bar, line, scatter and grouped bar charts with aggregation and a colour-by breakdown, histograms for distributions, a Pearson correlation matrix across numeric columns, and a pivot table taking a row field, an optional column field, a value field and an aggregation.
Can DataLens generate documentation?
Yes — documents are generated from the models, mappings, pipelines and profiling in your workspace, grouped by who reads them. Types include a Data Architecture Document, Data Model Specification, Technical Handover Document, Pipeline Design Document, Source-to-Target Mapping, Pipeline Runbook, Data Governance Summary, Executive Dashboard Brief and Insight Summary Report. Each carries a READY or PARTIAL badge so you know its coverage before generating it.
Can I produce PDF or Word reports?
On the Pro tier. Report exports to CSV and Excel are available on any tier; PDF and Word report export are entitlement-gated, and where a workspace is not entitled the app shows an upgrade card rather than a button that fails.
Limitations
What it does not do. Worth reading before you plan around it.
Does DataLens replace my data warehouse?
No, and it is not trying to. It sits in front of one — landing, cleaning, modelling and governing data on the way in, and publishing governed products on the way out. If you need a warehouse, you still need a warehouse.
Does DataLens write back to my source systems?
No. Database, CRM, lake and API connections read into DataLens. Nothing is written back to the source. Exporting SQL DDL gives you the statements to create a target structure, but running them against your database is something you do outside DataLens.
Does loading data keep it in sync automatically?
Not by default. A load is a point-in-time snapshot for uploads, database tables, API calls, file-server files and lake files alike. CDC Sync is the mechanism for keeping a dataset current against a PostgreSQL or MySQL source.
Can DataLens see transformations that happened before the data reached it?
No. Lineage records what happened inside DataLens — the source it arrived from and every step applied since. Transformations applied upstream in an ETL job or the source system itself are outside its view.
Are there limits on what PII detection finds?
Yes. Detection covers email addresses, phone numbers, dates, URLs, postcodes and ZIPs, currency, IP addresses and booleans. Personal data that matches none of those patterns — a name inside a free-text note, for example — is not detected. Use it as a strong first pass, not as a guarantee.
What is only available on Pro?
Quality Rules, the Dictionary and Column Naming under Govern; log-based CDC capture; data products; and PDF and Word report export. Each is marked in the product, and where a workspace is not entitled the app shows an upgrade card rather than a failing button.
How accurate are the forecasts?
The methods available are linear trend, moving average and exponential smoothing — transparent statistical techniques, appropriate for planning, not a substitute for specialist forecasting where that is warranted. A simulation projects from your data under assumptions you set, and a driver that is not in the dataset cannot be modelled.
Step-by-step guides
23 how-to guides cover these tasks in detail, screen by screen.
Upload a CSV or Excel file
Load a spreadsheet or delimited file and get a profiled dataset you can clean, model and chart.
Connect a database
Connect PostgreSQL, MySQL, SQL Server, Redshift, BigQuery or Snowflake, browse the tables and load what you need.
Explore a source model
See the tables, columns and relationships of a system you did not design — as a diagram you can read.
Profile a dataset and find PII
See what is really in each column, and find the personal data before it ends up somewhere it should not.
Trace where a column came from
Follow a field back from the dataset you are looking at to the source it came from, step by step.
Publish and export data
Export as CSV, TSV, JSON, JSONL or Excel, publish an API endpoint, or generate a PDF or Word report.
Still have a question?
DataLens is in private beta. Request access and try the answer rather than reading it.
Request beta access