Fasta header trimming

Question

[leo1985.arnab]

I have a fasta file with hundreds of sequences and their respective headers. The headers (all of them) are in the format

>ABCD [id_123] (gene_XYZ) [protein_ijk] [protein_id=qqq] [123..899]

.......seqeunce............

>EFGH [id_999] (gene_PQR) [protein_tre] [protein_id=trs] [573..789]
......seqeunce............

and so on.....

For the header every info in parenthesis are continuous and are only separated by a single space each (just as written above). All I want to do is retain "ABCD" (the very first info) in the header corresponding to every sequence . I want to loop through all the headers that are present in the file and return something like this :

>ABCD   
.....sequence.....
>EFGH  
.....sequence.......

and so on......Any help is most appreciated and i am working with BASH and perl.

Thank and regards!

[GenoMax]

With reformat.sh from BBMap suite: reformat.sh in=your.fa out=new.fa trd=t

[leo1985.arnab]

I dont know why the sequence is showing next to the header when i posted this here! Of course it is a fasta file and hence the sequences are directly below the headers.

[GenoMax]

I have reformatted your post to show the correct format of fasta files.

[leo1985.arnab]

Okay. Thanks for that...

Answer 1

[GenoMax]

In bash: cut -d ' ' -f1 your_file.fa > new_file.fa

[leo1985.arnab]

Worked well.....thanks!

[david.william.roberts]

That's Wizard level amazingness there!!! Thanks!

Answer 2

[shenwei356]

Lightning fast solution using seqkit (usage of seqkit seq), just download the binary file for Linux, decompress and immediately run:

./seqkit seq -i seqs.fa > seqs2.fa

Answer 3

[Alex Reynolds]

If you want a fast and generic/flexible approach to parsing FASTA, use awk:

$ awk 'BEGIN{RS=">";}NR>1{ split($1,a," "); print ">"a[0]"\n"$2; }' in.fasta > out.fasta

[leo1985.arnab]

Thanks for all your replies ! However, I was looking to retain the actual sequences also along with the shortened header. Infact I was myself able to shorten the header to the first word before posting this here. BUt the problem was I could not figure out a way to shorten the header and keep the sequences intact. So, I was wondering if there is any way I could also retain the actual sequences along with the headers. In short- I want to retain the entire sequence intact for all the entries and just shorten the name of the headers.

Meaning :

ABCD [id_123] (gene_XYZ) [protein_ijk] [protein_id=qqq] [123..899] .......seqeunce............

will now look like

ABCD .....sequence.....

and I need to do this for the whole fasta file (all headers and sequences)

Thanks again!

[GenoMax]

So you don't have a standard fasta format sequence file where first line is an identifier >some_id and the sequence follows on the second line? If you had said this yesterday then I would have reset the formatting. My apologies.

Your sequence is present on the same line as the identifier and you want to keep it on that line after shortening the header. Is that correct?

If the length of the extra stuff is always the same in all sequences then see if this works cut -d ' ' -f1,7 your.fa > new.fa

I am leaving this post here since child posts will disappear if I delete this. Content is no longer applicable.

[leo1985.arnab]

sorry again genomax2, the formatting got disrupted again in my posting today. It is exactly the way it was posted yesterday. (top of my post) the sequence IS on the second line (beneath the header) as it should be in a regular fasta file

Alex,

Here is a snippet from my actual fasta file:

>ABCD_gene_1 [gene=XYZ] [location=1..2231]
AGAGTGTATTGATGAGTCTCCATGGGAATGTGAAATGGCTGAAATGTTTGAAGAAACTGTTTTAGGGGAT
AGGAGACTTGGGAGTATGTATGGGGTGGTTGGATTTGTCACATTGATCTTGTTGGGGACATGCATGTAAA
...............................

>PQRS_gene_2 [gene=PQR] [location=1..2618]
CGCGCGGCCCAGGAAGTGCGCGCTGTTGCCCCGGAAGTGCACGCGCGGGGTCACCGGAAGCGGCGCGTCG
GGAGGATGCCGCTGCCTGTCCAGGTCTTCAACCTGCAGGGTGCAGTGGAGCCCATGCAGATTGATGTGGA
........

The list goes on for another several hundred sequences. The final output that I am looking for is:

>ABCD_gene_1
AGAGTGTATTGATGAGTCTCCATGGGAATGTGAAATGGCTGAAATGTTTGAAGAAACTGTTTTAGGGGAT
AGGAGACTTGGGAGTATGTATGGGGTGGTTGGATTTGTCACATTGATCTTGTTGGGGACATGCATGTAAA
...............................

>PQRS_gene_2
CGCGCGGCCCAGGAAGTGCGCGCTGTTGCCCCGGAAGTGCACGCGCGGGGTCACCGGAAGCGGCGCGTCG
GGAGGATGCCGCTGCCTGTCCAGGTCTTCAACCTGCAGGGTGCAGTGGAGCCCATGCAGATTGATGTGGA
........

and so on for all thee headers and sequences... for the rest of the whole fasta file.

I am hoping the post will come up correctly formatted this time. Otherwise, please know that my file looks just like regular fasta file (as correctly formatted by genomax2 yesterday).Hope this helps!

Thanks !

[GenoMax]

For future reference, it is safer to use the "code" formatting tool (101010 button) when formatting things like code/file formats. I have done this for you (and also reset the format original question).

So you do have a normal fasta file (since there is no formal spec for fasta this would do).

Edit: @Alex's solution as posted above did not work with the example data posted today (which is not the same as the original post).

[leo1985.arnab]

Thanks genomax2 ! Infact your posted asnwer (cut command) from yesterday is doing the job fine. I must have erred on something, which gave me a different result last night and I appreciate you pointing out the formatting tool button. I am new to the forum and I will surely take care of these stuff before posting next time.

My issue is solved- and thanks to all who took time in contributing your answers. I learnt several new ways in managing such scripting situations for the future. Thanks everyone!

[Alex Reynolds]

My awk statement should shorten headers and preserve sequences in FASTA files. I'm unclear what the issue is on your side, but if you want to post a snippet of your file and what results you're getting, I'd be happy to try to help.

[wang-yanfang]

Hey Alex,

I have a similar problem, could you please help. I also want to short my fasta file header, which is like below, I listed two sequences.

>lcl|VSMA01000001.1_prot_KAB5584702.1_1 [locus_tag=GE09DRAFT_1165795] [db_xref=InterPro:IPR002198,JGIDB:Conioc1_1165795] [protein=tetrahydroxynaphthalene reductase] [protein_id=KAB5584702.1] [location=join(1826..1931,1988..2458,2736..2863,2927..3064)] [gbkey=CDS]
MPGLTTNTGKYDQIPGPLGLASASLEGKVALVTGAGRGIGREMAQELGRRGAKVIVNYANSQESAEEVVQAIKKSGSDAA
SIKANVSDVDQIVRMFDEAVKVFGKLDIVCSNSGVVSFGHVKDVTPEEFDRVFNINTRGQFFVAREAYKHLEVGGRLILM
GSITGQAKGVPKHAVYSGSKGTIETFVRCMAIDFGDKKITVNAVAPGGIKTDMYHAVCREYIPNGINLTDDEVDEYACTW
SPLHRVGLPIDIARVVCFLASQDGEWINGKVLGIDGAACM
>lcl|VSMA01000001.1_prot_KAB5584703.1_2 [locus_tag=GE09DRAFT_1165796] [db_xref=InterPro:IPR021840,JGIDB:Conioc1_1165796] [protein=hypothetical protein] [protein_id=KAB5584703.1] [location=complement(join(3193..3215,3871..4374,4440..5628,5725..5886,5941..5989,6050..6066,6130..6234,6286..6495,6547..6561,6622..6728,6843..7103,7155..7719))] [gbkey=CDS]
MFHPSRRRAEQTAYEYNIQATEDHEHDHGVVNLSAEKRRRPRGKRPNYKPTALKWPFIVAQILVLVIAMGLIIWAEKAMP
DSDSTAIIDPLPSKGLPERSVKPEFGKHFRRDNTSGVVETATSQLDVQETTLTGGDGLITPGLGSTNGPADNVKTAVTDD

And I only want to keep the header like this:

>GE09DRAFT_1165795
MPGLTTNTGKYDQIPGPLGLASASLEGKVALVTGAGRGIGREMAQELGRRGAKVIVNYANSQESAEEVVQAIKKSGSDAA
SIKANVSDVDQIVRMFDEAVKVFGKLDIVCSNSGVVSFGHVKDVTPEEFDRVFNINTRGQFFVAREAYKHLEVGGRLILM
GSITGQAKGVPKHAVYSGSKGTIETFVRCMAIDFGDKKITVNAVAPGGIKTDMYHAVCREYIPNGINLTDDEVDEYACTW
SPLHRVGLPIDIARVVCFLASQDGEWINGKVLGIDGAACM

I would be super greatful for your help.

Thanks. Yanfang

[GenoMax]

See if this works:

$ awk '/^>/ {printf("%s%s\t",(N>0?"\n":""),$0);N++;next;} {printf("%s",$0);} END {printf("\n");}' < your.fa | awk ' {if ($0 ~ /^>/) {split($0,a,"="); split(a[2],b,"]"); print ">"b[1]} {print $9} }' | tr "\t" "\n"  | fold -w 80 
>GE09DRAFT_1165795
MPGLTTNTGKYDQIPGPLGLASASLEGKVALVTGAGRGIGREMAQELGRRGAKVIVNYANSQESAEEVVQAIKKSGSDAA
SIKANVSDVDQIVRMFDEAVKVFGKLDIVCSNSGVVSFGHVKDVTPEEFDRVFNINTRGQFFVAREAYKHLEVGGRLILM
GSITGQAKGVPKHAVYSGSKGTIETFVRCMAIDFGDKKITVNAVAPGGIKTDMYHAVCREYIPNGINLTDDEVDEYACTW
SPLHRVGLPIDIARVVCFLASQDGEWINGKVLGIDGAACM
>GE09DRAFT_1165796
MFHPSRRRAEQTAYEYNIQATEDHEHDHGVVNLSAEKRRRPRGKRPNYKPTALKWPFIVAQILVLVIAMGLIIWAEKAMP
DSDSTAIIDPLPSKGLPERSVKPEFGKHFRRDNTSGVVETATSQLDVQETTLTGGDGLITPGLGSTNGPADNVKTAVTDD