Questions tagged [duplicate]
This tag is ambiguous. Please use a more precise tag instead.
88 questions
0 votes
1 answer
496 views
iptables duplicate port traffic
I want to clone/duplicate all udp traffic incoming on port 8500 to port 8600. It is important that the source address is not modified. Also both ports must be accessible by applications (the packets ...
- 43
0 votes
0 answers
35 views
Linux home dir has a "duplicate" under /home/music but when anything is deleted from one it disappears from both -- how can I delete 2nd home dir?
I don't know where the 2nd "phantom" home dir came from. Properties folder shows it's 4K. The "real" home directory is 128,000+ files and 208GB. User10489 had the answer: a symlink ...
0 votes
3 answers
73 views
Filter duplicated based on values of another column
I have the following example of a dataframe.Where you see that elements of 3nd column could be duplicated.I want to keep the entry which has the highest value in column 5 Meaning that for AGCCCGGGG I ...
0 votes
3 answers
144 views
Need assistance with awk/sed to identify/mark duplicate IP addresses
Good day. I have a text file which contains pod/node names and associated IPv6 addresses of which two pods have the same IP address, first pod k8-worker0001c-cif-9d86d6dd4-vf9b9 and last pod k8-...
- 59
0 votes
2 answers
195 views
awk is automatically duplicating some lines. Can someone explain?
My data looks like: A 4 G 1 G 1 C 4 C 2 C 2 T 6 T 5 T 5 A 6 T 2 T 2 C 6 T 2 T 2 T 6 G 2 G 2 I am trying the command: awk -F " " '$1==$3 {$7=$6; print $0;} $1==$5 {$7=$4; print $...
1 vote
1 answer
1k views
Find duplicate IPs for different MACs
Using arp-scan to get a list of returned duplicate IP address. However, arp-scan will list duplicate IP with the same MAC address. I get a sorted output of asx.txt (shortened for brevity) arp-scan 172....
user552826
0 votes
0 answers
213 views
Removing duplicate values based on two columns
I have a file that would like to filter duplicate values based column 1 and 6 ID,sample,NAME,reference,app_name,appession_id,workflow,execution_status,status,date_created 1,ABC,XYZ,DOP,2022-08-18 13:...
- 113
1 vote
1 answer
371 views
How to sort a list of strings that contain a combination of letters and numbers
I want to sort following strings by the number and remove duplication in a file cat311 celine434 celine434 celine5 jimmy12 john44 john41 to be celine5 jimmy12 john41 john44 cat311 celine434
- 11
0 votes
0 answers
80 views
Delete duplicated contents from files
I have many backups of a same file. Is there a way to transform that into incremental backup? Those files aren't exactly the same (not same timestamps sometimes, sometimes new data appended here and ...
- 155
-1 votes
1 answer
133 views
Skip line from console if equal than line before, adding count (in realtime)
Using uniq it is possible to filter out sequential duplicate lines. while (true) do echo 1; echo 2; echo 2; echo 1; sleep 1; done | uniq becomes: 1 2 1 Is there a way to have duplicated sequential ...
- 101
-1 votes
1 answer
2k views
remove duplicate lines across multiple txt files [closed]
I have 12 text files all in one folder, each with about 5 million lines, each file has no duplicate line on its own but there are duplicated across multiple files, I want to remove the duplicate lines ...
1 vote
2 answers
1k views
Remove duplicates of specific line keeping only the first appearance of each without touching other unspecified duplicates
I'm trying to edit a text file containing several duplicates. The goal is to keep only the first match of a string and remove the rest duplicate lines of the same string. In the example file * Title 1 ...
- 13
2 votes
1 answer
2k views
ZSH - PATH Duplication : Directory added at end of PATH keeps duplicating when re-opening Terminal Session
I have recently installed PIPX on MAC running Big Sur and ZSH shell. During the install it prompted for the following to be added to the .zshrc file.... # Created by `pipx` on 2021-03-20 14:22:23 ...
- 39
0 votes
0 answers
198 views
I have a `raspivid` stream, which I'm piping to `ffmpeg`, now i'd like to also stream a raw version of it to a socket?
I have a process outputing an MJPEG video stream, which I pipe into ffmpeg to reduce framerate and then to a socket. raspivid -t 999999 -cd MJPEG -w 1920 -h 1080 -o - | ffmpeg -i - -f mjpeg -r 2 - | ...
- 151
1 vote
1 answer
923 views
How to use rmlint to merge two large folders?
In exploring options to merge two folders, I've come across a very powerful tool known as rmlint. It has some useful documentation (and Gentle Guide). I have a scenario that I previously mentioned and ...
- 706