Hi i want to make new duplicate search rule

I created a new workplace and added a new section. I wish it would look for duplicates for the records in this section. Which has the same order date, account and Opportunity

- created new order (object - zamowenia, add new order)

Like 1

Like

6 comments

Hello!

Please ensure that the duplicate search rules were added to the custom section according to the instruction.

The bulk duplicate search service works by Global Search service. Global Search can index only strings and lookup columns.
As a result, adding the deduplication rule to a DateTime column is not possible.

I don't have any attributes to add but I have got list page and form page

 

Arkadiusz Polus,

Please check the "Indexing for full-text search" parameter for the custom section in the Section wizard.

I created it in the application hub and I don't see such a checkbox anywhere

Arkadiusz Polus,

 

Unfortunately, Duplicate search rules cannot be added to a new section that was created in the Application Hub.
This functionality will be implemented in the 8.0.6 version.

thank you!

Show all comments

Hi,

When searching duplicates, we have no clue how many duplicates there are when the results are shown, there is no total number showcasing this.

Is there anyway to find it out ?

Thanks,

Damien

Like 2

Like

1 comments

Hello Damien,

 

There is no such a metric that can show the total amount of duplicates found by the process. But I will create a query to our R&D department to check the possibility of adding it into the future releases of Creatio platform.

Thank you for the idea!

 

Best regards,

Bogdan S.

Show all comments

Hello!

Where can I find Accounts and Contacts, excluded from duplicates search as 'Not duplicate'?
There are doubts and some of same mistakenly were marked as 'Not duplicate' in global duplicates search and it is necessary to remove this mark

 

Thank you!

Like 0

Like

3 comments

Hello,

 

Can you please specify what Creatio version you have and also your Deduplication service version?

Hi Mira Dmitruk,

Sales Team. Version 8.0.3.2908 (Cloud)

How can I found Deduplication service version?

Hello,

 

For the mechanism of Bulk duplicates search using the deduplication service, in order to reset the "Not duplicates" flags of all marked packs of duplicates on the deduplication service, it is necessary to clean the UniqueEntity table in mongodb.

In future releases, it should be possible to change the logic of the "not a duplicate" mark so that this action can be canceled by basic tools.

 

In case you use the deduplication service in cloud, and you get the situation when you need to clean the table with "not a duplicate" in mongo, please don't hesitate to contact us and we will help you to clean it.

Show all comments

Hello! When merging duplicates when the data has different values, the system allows you to choose which one is correct. In my case, the data differs in several fields, but the system only offers one field.

 

Like 0

Like

5 comments
Best reply

Roman,

Hello, 

Adding it once again, should be visible now:

Best regards,
Anastasiia

Hello Roman, 

 

The column will be displayed in the "Merge duplicates" window,  as soon as there is a conflict between values of this column in the records you are about to merge. However, there are a few exceptions:
- column is included in the list of ignored columns;
- it's empty;
- it's a system column. 
As we see the column from your screenshot is included in list of ignored columns (base logic of the system):

More detailed information can be found on our Academy:
https://academy.creatio.com/docs/7-17/user/platform_basics/business_dat…

Best regards, 
Anastasiia

 

Anastasiia Zhuravel,

 

Thanks for your reply. Where can I see the list of ignored columns?

Roman,

 

Hello, 

 

As mentioned in the article I have shared in a previous message - "Creatio will not duplicate identical communication options, addresses, and noteworthy events."

It's a base logic of a system which is specified in system's code. The screenshot I've shared in a previous message displays the part of the code with a list of ignored columns.

Best regards,
Anastasiia

Anastasiia Zhuravel,

Sorry, but the image is not displayed

Roman,

Hello, 

Adding it once again, should be visible now:

Best regards,
Anastasiia

Show all comments

Hi Community,

I have a requirement that in details once you created a record with a record number(for Ex:-800009),  you can't create another record with same record number. I have to restrict the duplicate creation of record number.

Can anyone help me to achieve this?

 

Like 1

Like

4 comments

Hello Jagan,

 

Unfortunately, at the moment, deduplication functionality can only be used for the main columns of the object, i.e. You cannot set up rules for searching for duplicates for details.

 

Details pull information from another section. It is necessary to search and merge duplicates in the section itself. 

We have already registered the idea for our R&D team to implement this functionality in further releases. I will assign your case to this project in order to increase its priority.

 

Best regards,

Bogdan

Hi Bogdan,

Can I get the script code for How to achieve the deduplication functionality for the  main columns of the object?

Regards,

Jagan

Jagan Nayak,

 

Hello,

 

Unfortunately, as of now we do not have any ready to use examples of such implementation done by code. 

 

Best regards,

Anastasiia

+ 1 for this functionality

Show all comments

Hi Team,

How does this merge records will work?

There are dplicate record in a section and this "Merge Record" menu option is disabled. Bulk duplicate search service installed.

If "Show duplicate Account" duplicate rule is ran, it shows the list and the merge works and generally if a duplicate record is searched in filter and if there are multiple entries, after selecting all duplicate entries, this merge record menu option is disabled.

 

 

Besr regards,

Bhoobalan Palanivelu.

Like 1

Like

4 comments

"Merge records" on the actions menu should become enabled when you select more than one record in the list (as long as the user also has the "Duplicates processing" (CanMergeDuplicates) operation permission). Could it be that the user account doesn't have this permission?

Ryan

Ryan Farley,

Thanks for the note!

1. Here more than one duplicated record is selected
2. The logged-in user is the supervisor and has the "Duplicates processing" (CanMergeDuplicates) operation permission). 

 

Note:
If a record is filtered and multiple entries (i.e., duplicates) are selected this merge record is disabled. If multiple records in a section are selected without applying any filters in the section filter (OOTB filter option --: "Merge Record" option is enabled).

 

 

Best regards,

Bhoobalan Palanivelu.

Bhoobalan Palanivelu,

I looked at the code for the merge button, it looks like it sets visible based on if the user has the permission or not, not the enabled property. For the menu item to be enabled, it looks like it just uses the "isAnySelected" to determine if any records are selected in the list (isAnySelected is implemented in GridUtilitiesV2 mixin). 

Apparently, that is returning false for your section. Do you have any console errors showing when using that section?

Ryan

Ryan Farley,

No console errors for the section.
Now it works. But haven't changed any operation permission or configuration.

Thanks for the insight !
It seems the property enabled/disabled is based on  "isAnySelected"  attribute and the operation permission read from "SysAdminOperation" which defines the access right.

could you please help with the module that has this Merge menu code? 

 

 

Best regards,

Bhoobalan Palanivelu.

 

Show all comments

Hi Team,

we are trying to merge duplicate lead. The duplicate rule which has been set up, shows the duplicate and when we try to merge those records. The records id not getting merged. It still ends up displaying the two records and it doesn’t show any error message also.

Create instance being used is 7.18.2

Question : As there is no error message showing up, can we know how can we can merge the records.

Note : We did verify the system settings and Operation permission and all the permissions has been provided

 

Regards,

Mayan

File attachments
Like 0

Like

1 comments

Hello Amritha,

 

The issue was resolved in terms of a support case. Please do not hesitate to contact Technical Support if you face any issues like that.

 

Thank you!

 

Best regards,

Bogdan S.

Show all comments

Dear Community,

 

I am sure that adding a duplicate search rule is as simple as clicking on the "new" button. The thing is that this button is gone... Does anyone else know what the cause of this is?

Is the feature disabled?

Is there a specific permission?

Is there a max of rules?

This is how my page looks like:

https://prnt.sc/xyxe6d

 

 

Kind regards,

Yosef

Like 0

Like

1 comments
Best reply

Dear Yosef, 

The behavior you have described looks like you are using an old duplicate search mechanism on that website which doesn't allow you to create your own custom DS rules. 

Please contact our support team at support@creatio.com so we could enable/provide you with instructions on how to enable the ElasticSearch duplicate search tool. 

Kind regards,
Roman

Dear Yosef, 

The behavior you have described looks like you are using an old duplicate search mechanism on that website which doesn't allow you to create your own custom DS rules. 

Please contact our support team at support@creatio.com so we could enable/provide you with instructions on how to enable the ElasticSearch duplicate search tool. 

Kind regards,
Roman

Show all comments

How do I check which version of the global search service I have?

If you use Creatio cloud, you will always have the latest version of the global search service.

If you use Creatio on-site, run the following console command:

docker ps

This will open the list of all containers. The number of global search version will be available in the “image” column.

How do I initiate the re-indexing of my Creatio site?

For global search versions lower than 2.0:

1. Open gs-mysql container via the following command:

docker exec -it gs-mysql bash

2. Run the following command in the opened gs-mysql container:

mysql -p1665017 use gs; UPDATE GlobalSearchIndexingEntity SET LastIndexedOn = NULL, InProcess = 0;

For global search version 2.0 and up:

Execute the following request on

gs-web-api: `/indexation/{siteName}/reindex/full

How do I enable logging the global search service?

By default, the service logs only errors. To enable logging of all events, locate the following string in the docker-compose.yaml file:

-Log4NetPath=${LOG$NET_CONFIG_FILE:-log4net.production.config}

Replace the string with the following string:

-Log4NetPath=${LOG$NET_CONFIG_FILE:-log4net.debug.config}

Note that if you enable logging of all events, the number of log files will increase significantly.

Which metrics and tracking schema can I use to monitor the global search operation?

Execute the following request:

http://[GS-WEB-API]:81/sites/[SITE_NAME]/search/state

Here, [GS-WEB-API] is the server address, and [SITE_NAME] is your Creatio website name.

How do I set up access to ElasticSearch via a password?

You can restrict access to ElasticSearch using Haproxy, which supports base64 authentification. Use the x-pack plugin to set up access to ElasticSearch via a login and a password.

How do I add a new object to the ElasticSearch indexing, or change the settings for the indexed fields of existing objects?

You can enable and configure indexing of specific sections using Creatio in-app tools. By default, ElasticSearch will index only sections, regardless of their author, as well as lookup columns (with a few exceptions). The attached PDF file contains the list of exceptions.

How do I deploy ElasticSearch on several servers with a single URL? How do I set up clustering?

This information is available in the Elastic service documentation.

Why the “Duplicates search rules” setting is not displayed for me?

Check if the “DeduplicationWebApiUrl” system setting is populated and whether the following features are enabled in “FeatureToggle:”

  • “BulkESDeduplication”
  • “ESDeduplication”
  • “Deduplication”

Learn more about working with additional options in the “Feature Toggle. Mechanism of enabling and disabling functions” article.

Can I use the global search and bulk duplicate search services in two Creatio applications simultaneously?

If you are using two Creatio applications, for example, production and developer environments, set up the global search and bulk duplicate search services for each of them independently. Use the following guides to set up the services:

 

File attachments
Like 1

Like

Share

1 comments

Hi Andre Kosolapenko,

Thanks for the article. I have performed the operation as guided for re-indexing and below is the result I got and it states that 0 rows got affected.

 

Is there any additional items to be handled ?

Please let me know.

Thanks in advance!

Show all comments

Hello all,

I am working on configuring the duplicate records found page. Is there a way to be able to click on the duplicate record and be taken to the duplicate's record page?

Like if I am adding a record for Kevin Brady, and then this page appears. Can I click on one of these records to say that the found duplicate is actually the record I'm looking for? It seems limiting that my only options are to either back up or to just continue and save the duplicate.

Like 0

Like

1 comments

Hello Kevin,

Unfortunately there is no way to setup system in the way so if you click on duplicates on save list record you are redirected to this record. It was always like that and I've already created a problem to our R&D team so they could add this possibility in an OOB version of the application. Currently you need to return to section list after saving the record and create filter that returns all duplicates records and merge them in section.

Thank you for the idea of Creatio application logic improvement!

Best regards,

Oscar

Show all comments