There are many systems that contain data and each one works differently. In Biuwer we have a catalog of connections where you can find those data connection types that are supported natively by the platform.
Biuwer is a business data analytics platform and therefore most connectors correspond to SQL or NoSQL databases. However, you can also upload your data stored in files with a CSV or Excel extension and we are also continuously working on expanding the catalogue of connections, especially with cloud applications. If you have any specific requirements, please don't hesitate to contact us through the online support.
Connections that my Organization has defined appear on the following screen.
From the "My connections" menu, we can see the most relevant information regarding connections, shown in a list:
Name and description given to the connection
Number of Datasets associated with the connection
Number of Data Models associated with the connection
Connection creation date
From the screen we can perform the following operations:
Search and filter connections using different criteria
Sort connections using different criteria
Add a connection
Access the editing details of a connection
Test a connection
Disable a connection
Perform a reverse engineering over a connection
Delete a connection
You can directly access the "Connection Catalog" to create a connection from the left side menu of the Data Center or by clicking the "Add" button in the upper right corner of "My Connections" list.
All possible technologies you can connect to, available in Biuwer, are shown in this catalog, and they are searchable by name and category.
When you click on one of the options shown, depending on the technology you will be asked to configure some details or others.
For example, to create a new connection to a PostgreSQL database you need to configure the following parameters:
The available options in the connection catalog that allow you to upload data contained in CSV or Excel files to Biuwer use a file importer.
To select the file to be uploaded to Biuwer, you can either drag it from a local file browser or click on the box. As soon as the file is selected, you can process it by clicking on the "Process file" button. This reads the contents of the file and detects the columns, their data types and formats, using the default settings.
As every data file is different, it is most likely that you will need to make some adjustments and try out various settings among those available in the file importer.
You can set up the following:
Character assigned to quotes (in text type fields)
If the first row of the file contains the name of columns
If you want to omit the first N rows of the file
What is the format of dates within the file
What is the format of boolean-type fields in the file, that is, what value corresponds to True and what value corresponds to False.
What is the number format (thousands character and decimal character)
Before proceeding with the import by pressing the upper right "Import" button, you can adjust any of the above parameters. With each change the file will be reprocessed and you will be able to:
View a data preview (first 30 rows are shown).
Select all or some of the fields. This is important because if the file contains, for example, 20 fields but only 12 of them are to be analysed, the 8 that are not of interest may not be selected and will not be uploaded to Biuwer.
For each selected field, Biuwer auto detects and sets its data type and whether it is a Metric or a Dimension type field.
This tool allows users to easily define Datasets in Biuwer. It has been created to make it as quick and efficient as possible to create and maintain datasets and all data fields to be analysed over time.
Reverse engineering is only available on certain Data Connections that allow it, as it consists of Biuwer connecting to the database system or remote API and scanning which data entities exist, how they are called, which fields they have and what types of data they are.
To configure reverse engineering, you can access directly from the "Reverse Engineering" menu, available in the left side menu of the Data Center, or from the list of connections or dataset tab, in its fields tab.
To configure reverse engineering you must select a connection and if that connection has containers, select one or more of the available containers, before clicking on the "Read Datasets" button. Results are presented visually in a list of data entities, with their fields and data types.
On this screen, before you import datasets into Biuwer by clicking the "Import" button in the upper right-hand corner, you can do the following:
Select datasets you are interested in using with Biuwer. Use individual selectors or "Select all" or "Deselect all" buttons.
In turn, by opening datasets, the fields you can select are displayed, with their original data type (in the remote database or API) along with the data type in Biuwer and the field type (Dimension or Metric).
When importing Datasets from reverse engineering:
New Datasets that do not already exist in Biuwer will be created, with the selected fields and the specified configuration.
Datasets that already exist in Biuwer will be modified, modifying fields that have been selected that already exist, or adding the new fields.
The proper use of reverse engineering of data can greatly facilitate the evolutions we may have over time in our data sources, such as new tables, new views, new fields, changes of names or changes of data types.
When Reverse Engineering is launched from the Fields tab of a Dataset, the screen will appear already configured with the data connection and the selected dataset is displayed.
In this case, only if there have been changes in source data fields or in their data types, we will be able to select them to update the dataset in Biuwer. Otherwise, as shown in the image, we will not be able to select any field to add or modify to the dataset.