Quick Search:
CODE
Oracle PL/SQL Code Library
JOBS
Find Or Post Oracle Jobs
FORUM
Oracle Discussion & Chat
 Perl Code: Remove Duplicate Lines from a File Jump to:  
Category: >> Perl Code >> Remove Duplicate Lines from a File Bookmark and Share

<< lastnext >>

Snippet Name: Remove Duplicate Lines from a File

Description: A quick and easy code snippet to remove duplicate lines from a file.

Comment: (none)

Language: PERL
Highlight Mode: PERL
Last Modified: March 05th, 2009

#!/usr/bin/perl
 
USE strict;
USE warnings;
 
MY $file = '/path/to/file.txt';
MY %seen = ();
{
   LOCAL @ARGV = ($file);
   LOCAL $^I = '.bac';
   WHILE(<>){
      $seen{$_}++;
      NEXT IF $seen{$_} > 1;
      PRINT;
   }
}
PRINT "finished processing file.";


Free
Oracle Magazine
Subscriptions
and Oracle White Papers


SQL University.net courses meet the most demanding needs of the business world for advanced education in a cost-effective manner. SQL University.net courses are available immediately for IT professionals and can be taken without disruption of your workplace schedule or processes.

Compared to traditional travel-based training, SQL University.net saves time and valuable corporate resources, allowing companies to do more with less. That's our mission, and that's what we deliver.

Click here to find out more
 
Home      :      Code Library      :      Sponsors      :      Privacy      :      Terms of Use      :      Contact Us 77 users online    © 2009 psoug.org

PSOUG LOGIN
Username: 
Password: 
Forgot your password?