View source for How to add a genome from Phytozome or JGI

One question we get frequently is how to add data from other genome repositories.  This tutorial is for JGI, but should work for most places.

===Instructions to load data===
# Go to [http://www.phytozome.net/ JGI/Phytozome]
# Go to the download section for your genome of interest
# Select and download the assembly (fasta) and annotations (GFF)
## Note: Select the gff file that contains both genes and exons "xxx.genes_exons.gff.gz"
## [[File:Screen Shot 2014-10-16 at 2.16.04 PM.png|thumb|center|100px]]
## Once downloaded, you can send these files to your iPlant Data Store and put them into the coge_data directory (to which CoGe has access), or you can upload them from your desktop.  We recommend using the iPlant Data Store due to its more robust file transfer methods.  However, your desktop should be fine as long as you have a decent bandwidth.
# Log into CoGe
# Go to your user profile page
# Press "Create" and select "New Genome"
## [[File:Screen Shot 2014-10-16 at 2.18.56 PM.png|thumb|center|100px]]
# This will take you to [[LoadGenome]] (or a popup in your profile for LoadGenome
# Fill out the necessary information about the genome.
## Note: I like to keep a newly load genome private until I had a chance to make sure the data loaded correctly.  Then I make it public.
## Note: You can add a link to the data file.  Unfortunately, JGI's download is behind an API so a directly link cannot be generated.
## [[File:Screen Shot 2014-10-16 at 2.27.03 PM.png|thumb|center|100px]]
# Add (upload) the assembly in fasta format.
## [[File:Screen Shot 2014-10-16 at 2.42.45 PM.png|thumb|center|100px]]
## [[File:Screen Shot 2014-10-16 at 2.42.59 PM.png|thumb|center|100px]]
# Press the red "Load Genome" button located at the bottom of the data selections
# A popup will appear stating that your genome is being loaded
## [[File:Screen Shot 2014-10-16 at 2.44.39 PM.png|thumb|center|100px]]
# When the genome has been loaded successfully, you'll get a thumbs-up and a link to go to [[GenomeInfo]]
## [[File:Screen Shot 2014-10-16 at 3.49.53 PM.png|thumb|center|100px]]
## [[GenomeInfo]] will appear in a popup in your profile page or in a new window.  GenomeInfo lets you get detailed information about your genome, manage data about the genome, send it to CoGe's analysis tools, and associate new data to the genome.
# To add [[structural annotation]]s to your genome, press "Load Gene Annotations"
## This will popup (or a load new window) of [[LoadExperiment]].  
## LoadExperiment will ask you to add information about your genome and to upload a GFF file for the annotations.  
# Add information about the annotation file and add your GFF file
## [[File:Screen Shot 2014-10-16 at 3.53.38 PM.png|thumb|center|100px]]
## Note: the gff file can be compressed in gzip
# Press the red "Load Annotation" button to start loading the annotations
## Note: Loading these annotations may take a while
## [[File:Screen Shot 2014-10-16 at 3.56.57 PM.png|thumb|center|100px]]
# You will get a thumbs up when the loading is complete and successful
## [[File:Screen Shot 2014-10-17 at 8.56.03 AM.png|thumb|center|100px]]
'''Loading Complete'''
===Testing and making the genome public===
Time to make sure that the genome and annotations loaded correct before making the genome public
# Go to [[GenomeInfo]] for your newly loaded genome
## [[File:Screen Shot 2014-10-17 at 8.59.29 AM.png|thumb|center|100px]]
# Check that there are sequences loaded by looking at the statistics for the genome
# Check that the annotations loaded correctly by clicking "Click for features" under features
## [[File:Screen Shot 2014-10-17 at 9.01.54 AM.png|thumb|center|100px]]
# Visualize the genome by pressing "View".  This will launch [[GenomeView]]
## [[File:Screen Shot 2014-10-17 at 9.05.11 AM.png |thumb|center|100px]]
# The genome should have gene models.  You may need to zoom out and scroll along the genome to see them.
# Check gene models by extracting protein coding features ([CDS])
## Move to a region with several gene models
## Move the mouse to the feature track title/name ("Features: all")
## Press the down arrow that appears when the mouse is on the feature track name
## Select "Send to FeatList".  [[FeatList]] will extract the features from the genomic region and display them to you in a list
## [[File:Screen Shot 2014-10-17 at 12.36.13 PM.png|thumb|center|100px]]
## Features are automatically sent to FeatList
## [[File:Screen Shot 2014-10-17 at 12.38.45 PM.png|thumb|center|100px]]
# In FeatList, check the checkbox for all the CDS features
## There is an option in the menu at below the feature list to do this
## [[File:Screen Shot 2014-10-17 at 12.38.59 PM.png|thumb|center|100px]]
## Select "FASTA Sequences" for where to send the features to
## [[File:Screen Shot 2014-10-17 at 12.39.08 PM.png|thumb|center|100px]]
## Press the green "Go" Button
## Features are sent to [[FastaView]]
## [[File:Screen Shot 2014-10-17 at 12.42.42 PM.png|thumb|center|100px]]
# In FastaView, the sequences are shown as DNA sequences
# To test to see if the CDS features were loaded properly, press "Protein" to translate the DNA sequence to amino acid sequence
## [[File:Screen Shot 2014-10-17 at 12.43.29 PM.png|thumb|center|100px]]
# When the translated sequences are returned, there is a count at the top that shows the number of sequences and the number of features.  If CoGe can determine the correct reading frame, only one sequence will be returned (the correct translation).  If CoGe can't determine the correct reading frame, all 6 translated reading frames will be returned.  If every sequence translated correctly, the number of sequence will equal the number of features.  If any sequence was translated into all 6 reading frames, there will be more sequences than features.
## All sequences translated correctly
## [[File:Screen Shot 2014-10-17 at 12.44.53 PM.png|thumb|center|100px]]
# Additional testing
## I sometimes run a synmap analysis using the new genome and a related genome.  Since I know what to expect from the results, it is another way to check if the genome was loaded properly.
===Make your genome public!==
Once the genome load has been validated, it is time to make it public
# Return to [[GenomeInfo]]
# Press "Edit Info" under the info box
[[File:Screen Shot 2014-10-17 at 12.49.47 PM.png|thumb|center|100px]]
# Deselect "Restricted"
# Press the green "Update" button to save.
[[File:Screen Shot 2014-10-17 at 12.49.52 PM.png|thumb|center|100px]]
# The genome is now public.