There are three ways to compare data:
The Comparison Tool function from the Extras menu enables you to compare different data lists, for example DQL query results with other DQL query results or with imported data lists.
The Object Compare List enables you to add single objects of any type, from any repository. These objects are compared attribute by attribute and you can modify them directly in the list.
Legacy Compare Data is the previous data comparator in dqMan 6, accessible via the options menu, will be phased out from dqMan's features in upcoming releases.
In the Object Compare List you can add single objects of any type, from any repository, for example a dm_acl object from repository A could be compared with a dm_cabinet object from repository B.
Tp add objects from the DQL query result list, call the Add to Compare List function from the context menu. There can be only one Object Compare list. All objects will be added to the same list which is automatically created when the first object is added. Closing the list removes all objects.
The attributes are aligned vertically. The object in the first column is the master object. All other objects are compared to the master object and differences are highlighted. Differences in single values of repeating attributes are displayed in red font color.
To change the master object, drag the new master object to the first column. If different object types are compared, attributes that are invalid for the object type remain grey and empty.
You can refresh the values of a column and also delete a column.
The context menu of the list offers additional functionalities, as follows:
| Functionality | What It Does |
|---|---|
Normally, you can only add one instance of an object to the list. If an object is sent to the list a second time, the list entry is updated without adding the object a second time.
Sometimes it is useful to follow the changes of an object throughout its process. Therefore, you can freeze an object by clicking the button in the header of the object.
You cannot update or modify frozen objects.
Additionally, the i_vstamp value is displayed in the header.
The Comparison Tool is a feature-rich utility designed to compare data from different sources, such as DQL query results, imported data lists, or clipboard data. This tool provides flexible options for comparing only the rows that differ between datasets, and it supports various combinations of comparison criteria.
The Comparison Tool requires at least two open data lists for comparison.
Data lists can be results from DQL queries, imported data lists, or data from the clipboard.
Different Rows Only: Compares and displays only the rows that differ between the two datasets.
Left-Only Rows: Displays rows present in the left dataset but not in the right dataset.
Right-Only Rows: Displays rows present in the right dataset but not in the left dataset.
Equal Rows: Displays rows that are identical in both datasets.
Columns with matching data are automatically identified and displayed.
Users can hide or unhide columns for comparison based on their preferences.
Double-clicking on a selected column removes the association for that column.
The "join" function enables the selection of columns for matching comparisons, while the "compare" function is utilized for specifying the columns intended for comparison
The equals button functions identically to the compare button, allowing for a direct comparison of values on a one-to-one basis.
Upon clicking the map button, a window will appear featuring a predetermined selection of mappings. Users are given the option to choose the specific mapping list to utilize when comparing the selected columns.
The match button automatically performs the matching process for both the join operation and the columns earmarked for comparison, eliminating the need for user selection. Unnecessary columns can be excluded from the context menu before the comparison.
The reset button will restore all matched values to their original state for comparison.
The case-sensitive option can be toggled on or off prior to initiating the comparison.
The exact order of repeating attributes option can be toggled on or off prior to initiating the comparison.
The data in the grids is refreshed automatically when the source data changes. This ensures real-time updates during active comparisons.
Columns with differences are visually highlighted in a distinct color in the header.
Identical columns are displayed in the normal color.
Accepted date formats for comparison can be configured in the Options.
A set of default date formats is preconfigured for convenience.
The tool automatically detects the date format for columns from CSV based on the first 10 rows.
Detected date formats are applied to all date fields for consistency.
The Date/Time formats can be configured in the Options/Compare Data.
If a date value cannot be converted to a valid date using the detected format, the value displayed in the grid will be "Invalid date."
In cases where disparities exist between the results exhibited in repository and a CSV/Excel file employed by the user, the user has the capability to update and synchronize the modified data with the pre-existing data in repository. It is important to note that the update process is unidirectional, allowing modifications solely from the user's data to repository, with no reciprocal update.
The updating procedure can be executed directly from the compare window by utilizing one of the designated update buttons. Within the update window, all columns are presented, with those necessitating updates marked with an "update" status. An API script for updating the metadata will be generated, and the API script window will automatically open. To implement the changes, users need to execute the script within the API script window.
After comparing, users can customize the data to display and export to an Excel file, regardless of whether the results are the same or differ. If differences will exist after comparison, they will be highlighted in the exported Excel file.
Following each comparison, a summary of the comparison will be presented, which can be toggled on or off for display. This summary will encompass the total number of records, along with the count of identical results, differing results, as well as exclusive values from the left or right side.
The system offers flexible Boolean field comparison to cater to user preferences. This feature allows users to configure accepted Boolean values within the Options, ensuring compatibility with diverse input styles. The default accepted values are '1', 'Yes', 'True', '0', 'No', and 'False'.
The default Boolean values recognized by the system are as follows:
True/False
Yes/No
1/0
More values can be added in in the Options/Compare Data.
As a user, you can expect the following behavior in Boolean field comparison:
Flexible Interpretation: Values such as '1', 'Yes', and 'True' are treated as "true", while '0', 'No', and 'False' are treated as "false".
Case Insensitivity: The comparison for Boolean values is case-insensitive. Whether entered in uppercase, lowercase, or a combination, the system interprets the values consistently.
Handling Unconvertible Values: If a value cannot be converted to "true" or "false", the system retains the original value and displays it as is. This feature helps users identify and rectify invalid input.
Support for Default Values: The Boolean comparison works seamlessly with any of the supported default values, providing a reliable and user-friendly experience.
A Mapping List is a collection of key - value pairs that can be used in Compare Data using the Compare Tool.
To generate a Mapping List, navigate to Extras/Mapping Lists, where you can create a new category along with a new mapping list.
Once the category and mapping list have been established, you have the option to manually input each mapping value individually, or you can utilize the import button to bring in a preconfigured mapping list.
Checking Exact Match makes the mapping list match key values only if they are exactly the same.
Checking Case Sensitive makes the mapping list match key values only if the case matches. Otherwise matches will be made regardless of case.
Additionally, there is an option for a default value if no match, allowing the user to define a default value for situations where no match is found.
In the mapping list, modifications can be performed using the add and delete buttons. Multiple values can also be removed by utilizing the Ctrl key for multiple selection or the Ctrl+A combination to select all available values in the mapping list.
This function is only available if at least two different data lists are open. These can be results from DQL queries from any repository or imported data lists. The assistant is described in the following sections:
First, select the two different data lists to compare from the dropdown menus. Subsequently, the comparison function is determined. The following functions are available:
| Function | What It Does |
|---|---|
You can customize the comparison using the options Compare case sensitive (which compares case sensitive occurrences) and Compare exact order of repeating attributes (repeating attributes can have the same values, but in different order).
The two data lists must allow correlation of the data records. At least one column of the source data list must be joined to one column of the target data list. These operations are performed in the second page of the assistant.
To join to columns, select the columns in both lists and click the button Join or drag-and-drop the desired columns onto the opposite list. To delete a join, use the context menu of the Selected Columns grid.
Selecting Search for different records causes the comparable columns to be defined additionally, which you can do using the Compare button or by pressing the Ctrl during the drag-and-drop of one column onto the opposite list.
The search is then performed for objects that can be joined by all Joins to columns, but that differ in the Compare to columns.
The results of the comparison are displayed on the last page.
The number of found data records can differ for both lists, since the criteria can be fulfilled by more than one data record.
The result of the compare operation are displayed in the corresponding data lists. All found records are marked as such. If the function Search for different records was executed, the rows with differences are highlighted.
The marks remain until either a new DQL query is executed in the session window, a new data compare is run or the marks are removed manually using the respective function from the context menu.
You can process marked records as a group, similarly as selected data records. Object functions, export functions and the Script Generator support marked records.
To execute a function for all marked records, you must select exactly ONE cell of any marked record and start the function. Selecting more than one cell or an unmarked cell causes the function to be be executed for the selected objects/cells only.
If the compare is executed using the Search for identical records or Search for different records functions, the rows in the two grids are linked to each other. Use center mouse click on a marked record in one list to scroll the other list to the corresponding record.
If more than one record from one list is linked to a single record in the other list, repeated mouse clicks on the single record will loop through all linked records successively.
If a Search for different records is executed, the function Add to Compare List will add the selected object and all the corresponding objects to the Object Compare List in one go if only one object is selected. The Object Compare List will be cleared first.
To delete a Mapping List select the desired mapping list and click on the Delete icon in the toolbar.
Edit
You can modify the values directly inside the table. A change is stored only after pressing Enter. You can modify repeating attributes inside a small sub-grid, which provides its own context menu for inserting, deleting or reordering values of the repeating attribute.
Copy
Copies all selected cells into the clipboard.
Dump Object
Dumps any valid object ID in the selected cell.
Goto…:
Searches for attributes in the list.
Show Attributes
All: Displays all attributes of all object types in the list. Master: Displays all attributes of the master object. Type specific: Displays type specific attributes of the master object type only. Identical values: Displays all attributes with identical values in every column. Different values: Displays all attributes with a different value in any column.
Compare settings
Compare case sensitive: Compares case sensitive. Exact order of repeating attributes: Repeating attributes can have the same values, but in different order.
Order Attributes by
Name: Sorts attributes by name Category: Sorts attributes by category, such as an object dump Not sorted: Attributes are displayed in content server generated order.
Synchronize with master
This functions enables you to copy values from the master object to compared objects. If any range of values is selected within the area of compared objects, all selected attributes (lines) will be copied to all selected objects (columns) of the list.
Search for identical records
Searches for identical records in both lists.
Search for missing records
Searches for missing records in both lists.
Search for different records
Searches for records that are joined by one or more columns but differ in other attributes.
