Remove Duplicates from CSV file

Hi, As the title explain itself. I have a csv file, i want to remove duplicate data from it.

I got the following code from the forum but it is not working:

{
“Name”: “AAAAAAA”,
“CreationDate”: “2022-11-21”,
“Commands”: [
{
“Command”: “csvReadArray”,
“Target”: “csvreaddata.csv”,
“Value”: “TEST”,
“Description”: “”
},
{
“Command”: “echo”,
“Target”: “${TEST}”,
“Value”: “”,
“Description”: “”
},
{
“Command”: “executeScript_Sandbox”,
“Target”: “var a = ${TEST}.toString().match(/([a-zA-Z0-9.-]+@[a-zA-Z0-9.-]+\.[a-zA-Z0-9_-]+)/g);\nlet b = […new Set(a)];\nreturn b;”,
“Value”: “A”,
“Description”: “”
},
{
“Command”: “echo”,
“Target”: “${A}”,
“Value”: “green”,
“Description”: “”
}
]
}

What kind of duplicates? Duplicate lines?