Difficulty: expert
Content
Table of Contents | ||||
---|---|---|---|---|
|
Learning Objectives
After reading this article, you’ll be able to:
Work through the general imports
Have you read: What are imports and exports in Workplace?? The article below repeats some of the information from that article and goes into further depth.
Basics
The import functionality allows for a quick upload of large datasets into Workplace. By using import connector with import mappings, it is possible to specify in which data table the various data should be stored.
Default imports are available to import masterdata when setting up an environment. This allows for quickly filling the environment with for example: contacts, properties, and areas. By default we use filed in csv-format for our imports.
Where to find imports
Some default imports are explained in detail in the articles that describe how to set up a new Workplace environment Solution Based Rollout || UNPUBLISHED. In general, imports can be accessed by:
Pressing the Import button on the startBoard. Imports can also be accessed via the navigation menu: Configuration>Import.
Open the import connector by clicking on the “reference”.
For this article we guide you through the properties import: FMB-F-021. After clicking the reference this page will open:
...
Note |
---|
Warning: If this import is not yet available in the list click: Generate default imports at the bottom of the import list. This will provide you with some general imports. |
Importing data
Generate an import template by clicking: Generate import template
A file will be provided in the include at the bottom called Template import xxx.
To download the file click the download icon.
In theory we send out this excel file to the client and ask them to fill it in. But more on this later.
After receiving the file back from the client we save the file as CSV UTF-8.
Import the file by clicking import file.
Select file by clicking Select files.
Importing the files will continue in the background. When we click: Ok, we return to the import page.
In the right top corner the importing icon will show up, when clicking on it we can see the import status.
After the import finishes we can see the results by clicking the document icon in the top right corner.
On the document page select Advanced Search.
In the field Dates: linked from/until fill in today’s date. (If we would search without filtering we would end up finding all documents that have been imported in this import connector)
Open the import messages by clicking the magnifying glass, here we can also consult the file that has been uploaded. The messages shown explain what happened when importing.
Import connectors
Connector mappings
The import we discussed in the previous steps seems to be a single Properties import. However, almost all imports that are generated by default consist out of multiple import mappings. In this case we import property objects as well as the address object. So, for every object that we want to import a separate mapping is needed. However, this is not the only reason we use different mappings, we could also use one specific mapping to only set the hierarchy of an object, so for properties this could be the hierarchy within the imported properties.
We can see this by navigating to the details tab
Scroll to the bottom include: Mappings. Here we can see what mappings are being used within this connector.
We are able to run mappings separately, this can be useful when we only need to import one of them, or when we want to see more easily where errors occur. To run a mapping separately:
Select a mapping by clicking on the magnifying glass next to the mapping name.
Click import
Select your file
The import will then run and show the results on the page.
Connector settings
Only partner users can change these settings. We will go over some important settings in the table below. Hover over a setting in Workplace to see the helptext.
...
Setting
...
Description
...
Log
...
If set to yes, maintains a log of all actions
...
Save documents
...
If set to yes, stores all import/export documents, these are generally removed after 30 days.
...
Save warnings
...
If set to yes, stores warnings when there are no errors. Normally the warnings/errors are only stored when there was at least one error.
The difference between an error and a warning in imports:
Error: data could not be imported because an error occurred
Warning: data has been imported but there could be columns missing/links might not been found.
Filling in import data
When filling in the import files there are a few things we need to keep in mind.
Every import mapping has different fields that have to be filled in.
Per mapping (object) we can open the mapping
We can then see what fields are being imported, in this example we will use FMB Property by clicking on the magnifying glass.
The fields where Key is set to: Yes are fields that are required for the import. Meaning that the import will not run when Key values are missing.
Aside from making fields mandatory Key values also allow for updating existing data in Workplace. Because Workplace will look for these values in already existing data and if this value is found rather than importing a new object, Workplace will update the fields. It will update all the fields except for the key values. We can use multiple key values per mapping, for importing addresses for example almost all fields are considered key values:
...
In this way we make sure we do not import a single address multiple times, but rather add the address as a separate object to properties.
Automating an import or export
It is also possible to set up imports to be executed periodically from an FTP server.
Automated export can be set up to export date to: FTP servers and email.
Summary
Rw ui textbox macro |
---|
|
Search
...
Table of Contents | ||
---|---|---|
|
1. General
Importing data allows you to bring information from external sources, such as files from other systems, into Workplace Management. This process involves:
Preparing the data to meet application requirements.
Uploading the data.
Validating for errors.
Once imported, the data is consolidated into a single platform and becomes available for various tasks like managing processes, generating reports, or conducting analyses. This ensures your information is organized and ready for use.
2. Technical background information
Info |
---|
This chapter goes into some technical details regarding how the default imports map the data to the relevant objects in Workplace Management, this information is only informative and no additional actions are needed when using the default imports, as this is already setup correctly. |
Workplace Management provides default import options for all relevant (master) data objects. These imports, technically referred to as ‘FtpConnector’, allow bulk data to be imported or exported, either manually or periodically. This article focuses specifically on manually importing (master) data using the default import options. Other methods, such as periodic imports from an SFTP location, are not covered here.
An import consists of one or more mappings, technically referred to as ‘FieldMap’. Each mapping defines:
The object to be imported.
The relationship between the column headers in the import file and the corresponding fields in Workplace Management.
Importantly, each mapping is related to only one object.
Example:
The following objects are relevant for the ‘own employees and users’ import:
Object: Person
Personal information such as first name and last name.
Object: Contact
Contact information such as phone number and email address.
Object: SystemUser
System user details such as the username.
Object: SystemGroupContact
Authorization details such as specific access rights assigned to the system user.
In this example, the default import ‘own employees and users’ will consist of 4 mappings, one for each object:
...
Depending on the import, there could be 1 mapping or 10 mappings linked to the import. Each mapping imports a part of the applicable object(s).
More information about the settings of the import and linked mappings will be applicable when customizing, see: /wiki/spaces/KB/pages/958562341.
3. Available default imports
In Workplace Management, the default available imports can be used to import (master) data in bulk. This data can be used in all relevant modules, used by the customer. For example, the building and area data is used in modules like ‘Reservations’ and ‘Requests’.
Module-Based Availability
Default imports are automatically enabled based on the activated modules. When a module is activated, its associated default imports are displayed directly within the module activation interface. All (generated) default imports can also be found via the administrators startboard:
...
From the 'Default imports' menu on the administrators startboard all activated default imports can be found. From this overview, the imports can be deleted and regenerated. When regenerating a default import, it will always fetch the latest version of the import.
Info |
---|
Regenerating a default import does only work, if the relevant (old) import is deleted first. Regenerating an import will copy the latest version of the import template and mappings from the baseline to the customers environment. This way the template will always correspond with the import on the customer environment and any changes done on the baseline will not “break“ the import for the customer. Imports can only be deleted by partner users. |
...
Via the 'Email import templates for selected items' the applicable template files can be send to the user. More on the templates explained below.
When opening an import, more information is directly shown on the ‘General’ page. The ‘Details' tab is only visible for level 3 administrators. On this tab, more details of the import and more technical settings are visible. The 'Log’ tab shows when the import has been executed.
...
4. Templates
Via the button 'Download template', the applicable template is directly downloaded to your computer. This file is an Excel file with multiple sheets. The import template includes a sheet with instructions, one or more sheets to fill in the data to be imported and possibly more sheets to enter client specific details e.g. custom area categories.
...
Via the 'Default imports' overview on the administrators startboard, it is possible to directly email the import templates of the selected imports to yourself. This email can then be forwarded to the customer, if desired.
...
More information on how to fil in the template, see: How to use the import templates.
Info |
---|
An import template or various mappings can be updated after a Workplace Management release. Make sure to regenerate the imports after a release, before sending it to the customer, to prevent sending an old import template, which might miss new mappings. |
5. Importing data
The import templates are .XLSX files, which are send to the customer to fill in all relevant (master) data. Once the customer is done filling in the import file(s), the customer sends back the files to the implementation consultant to import the data.
Before the data can be imported, the implementation consultant:
Opens the file(s) and confirmed all required data filled in (e.g. name of the building)
Opens the file(s) and confirmed all data filled in is according to the instructions (e.g. selected the correct option from a drop-down list)
Verifies that no relevant columns have been deleted
Saves the sheet with data to be imported as a .CSV file (for all sheets that contain data to be imported)
Verifies the field delimiter in the CSV file corresponds with the field delimiter of the user importing the data
If the file is filled in correctly by the customer, the process can continue. Via the 'Upload import file' button, the import can be executed.
Note |
---|
Avoid large imports (e.g. > 10.000 rows) during busy office hours: Large imports can strain system performance. Start such imports after office hours. |
...
More information about the file to be uploaded, is shown on the top of the screen:
...
The .CSV file to be imported, can be dragged and dropped in the dedicated location (grey block), or the file can be searched via the 'Selected files' option.
As soon as the file is dropped, the message is shown that the import is executed in the background. A background task is executed (as it states) in the background, while the user can continue with other things in the meantime.
...
Via the icon next to the username in the top right corner of the screen, any yet to start, ongoing and finished imports (background tasks) can be found:
...
Once the import is finished, the log files are generated and shown in the include 'Generated import documents (last 24 hours)'. This include shows log files which show the correctly imported data and possibly errors that might occurred. More information about these log files in the next chapter.
6. Log files for validation and debugging
By default the imports log files, generated after importing data, are shown via the include 'Generated import documents (last 24 hours)'. As described, the documents shown here are not older than 24 hours.
...
Info |
---|
Documents generated in the last 24 hours are shown by default. Older objects can still be found via the document search option found as an icon on the top right corner of the screen. |
After the import is completed, one or more log files are shown:
The file which was uploaded
A log file which indicates per line what has been imported
A log file with all errors
If only the first 2 files are shown, that means that no errors occurred and the data was imported correctly, or there was nothing to update in already imported data.
...
If the error file is also shown, then the import was (partly) unsuccessful. With this file, the debugging process can begin to see what is the reason the errors occurred. Below an overview of the most common error/warning messages.
6.1 Most common error messages
Message | Possible cause | Solution |
---|---|---|
Field does not exist |
|
|
Warning cannot find referenced object |
|
|
Creating or looking up an object for this key combination has failed |
|
|
Example error log 1:
...
There is no language with the identifier 'ent', so it could not be linked to the imported organization
There is no address with the combined identifier address: Groningensingel, nr: 11, addressLetter: C, postalReference: 6836 EA, so it could not be linked to the imported organization
There is no organization with the identifier ‘ORGANIZATION-7’ to be linked as the parent organization of the imported department
The above errors are considered warnings. The object itself is imported, but specific fields (e.g. language, address and parent organization) could not be set.
Example error log 2:
...
The area import is executed before the building import. When importing the areas, the corresponding building (which is part of the key to import areas) cannot be found.
This is considered an error, which results in the areas not being imported.