After two extremely busy months things are getting quieter again on the Ensembl training front. For December we have the following events scheduled:
3 Dec: Browser workshop for Master's students at University College London, London, UK
9 Dec: Browser workshop at Addenbrookes Hospital, Cambridge, UK
For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.
We have had to disable BLAST temporarily owing to excessive load on the servers. The service will be enabled as soon we have analysed the problem.
We have now repaired the BLAST database and the service is once more available. We will be monitoring the situation, but hopefully no further action will be required.
Please accept our apologies for any inconvenience caused.
We regret that owing to problems with our BLAST server, we have had to disable this feature temporarily, as issues with tickets were bringing down the whole Ensembl website. We will endeavour to have BLAST back online as soon as possible; please accept our apologies for any inconvenience caused.
October was quite a busy month for the Ensembl Outreach team, but November is even busier:
2 Nov: Developers workshop at the German Cancer Research Center (DKFZ), Heidelberg, Germany
4-10 Nov: Ensembl module in the Computational & Comparative Genomics course, Cold Spring Harbor, NY, US
5-6 Nov: Ensembl Genomes module in the EBI Roadshow at the University of Szeged, Hungary
9 Nov: Browser workshop at the German Cancer Research Center (DKFZ), Heidelberg, Germany
10 Nov: Browser workshop at the German Cancer Research Center (DKFZ), Heidelberg, Germany
12-13 Nov: Browser workshop at the University of Cambridge, Cambridge, UK
12 Nov: Browser workshop at the Jackson Laboratory, Bar Harbor, ME, US
13 Nov: Browser workshop at the Jackson Laboratory, Bar Harbor, ME, US
13 Nov: Presentation at the Jackson Laboratory, Bar Harbor, ME, US
16 Nov: Browser workshop at Harvard Medical School, Boston, MA, US
17-18 Nov: Ensembl module in The Genome Access Course, Cold Spring Harbor, NY, US
18 Nov: Presentation for EBI/EMBL Ph.D. students, Hinxton, UK
24 Nov: Browser workshop at the Centro Nacional de Investigaciones Oncológicas, Madrid, Spain
26-27 Nov: Developers workshop at the Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland
26 Nov: Browser workshop at the Royal Veterinary College, London, UK
28 Nov: Browser workshop at CEINGE Biotecnologie Avanzate, Naples, Italy
30 Nov - 1 Dec: Ensembl module in the Wellcome Trust Open Door Workshop - Working with the Human Genome Sequence, Hinxton, UK
30 Nov - 2 Dec: Developers workshop at the University of Cambridge, Cambridge, UK
For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.
From this little corner of the world Ensembl will be delivering an Interactive Workshop on Friday (October 23rd) from noon (12.00) in Room 315 in the Convention Center. If you want to attend, let us know as seating is restricted and we are allocating seats until the room is full. You must bring a laptop with a wireless card (and a fully charged battery).
Furthermore, you can also visit us on booth 432 where we will be happy to help you and get any feedback.
Mahalo
When we changed our look and feel almost a year ago, we "left behind" our two main graphical genome-wide comparative genomics displays (our textual comparative genomics displays remains, as did some of the gene centric ones). These were some of the most complex displays, not only in the graphics layout but also in aspects such as configuration - with comparative genomics tracks with up to 30 species, potentially one has the union of all tracks in each species, and doing this consistently required reworking how we thought about the "same" or "different" tracks across species.
It's taken longer than we thought it would, but finally in release 56 these displays are back and better than ever. With more aggressive caching of data items as they head to the web (and, in addition, if you are on the west coast of the US or the Pacific Rim, check out the US west mirror at uswest.ensembl.org) they go far faster, making them far more useable.
We have two fundamentally different ways of thinking about genomic alignments.
In "Multi Sequence View", which works fundamentally as a set of pairwise alignments, we maintain the linear sequence of each genome, and then draw regions which are conserved between them. Check out displays like:
Mouse/Human
And make sure you hit "Configure Page" and in the Comparative Genomics section, switch on blastz. I also like to have genes in "Collapsed, labels" (so alternative splicing doesn't produce excessive displays) and also switch on Regulatory Features.
Now - you get a nice picture of this region in human and mouse. The orthologous gene (PECI) has conserved exons, and the regulatory features at the start of this gene is conserved in human and mouse and both cases classified as a promoter. All as expected.
But a closer look shows that the transcript going by the catchy name of AC123437.5 in mouse, going on the opposite strand has some of its exons overlapping to the human PECI, and Human PECI is duplicated into two local genes here. This is perhaps easier to see as one zooms out in this display (notice you can drag-and-select in the upper panels, or use the + and - bars to change in the lower panels)
Zoom Out
In contrast, the alignment (Image) view, asks you to choose one species as the co-linear
reference, and then the other species are organised specifically by the alignment of that
reference. This is ideal in more linear, orthologous regions. I like using the 10-way EPO alignment for visualisation/gene model comparison, although to go things like conservation analysis, you want to use the 31-way mammalian alignment with the low coverage data
This is gene, well conserved across mammals.
Co Linear
We can look at the precisely the same alignment from the perpsective of Mouse, Rat, Dog, Horse, Human, Pig. In each case, the alignment is unbiased to each species. For example, the Mouse-Rat portion of this multiple alignment still aligns the unique rodent portions.
Here is that same region from the perspective of Cow:
Cow
Notice when you go to human you have a choice of not only 4 different multiple alignments - a 4-way primate alignment, a 10-way mammalian alignment, a 12-way alignment including chicken and 31-way mammalian alignment, but also 40 odd other individual pairwise alignments.
In each case, you can get the alignment out as text - here's a 4-way primate alignment:
Text alignment
or the same region in a 31-way glory
31 one way text
Of course, all this information is also available to download or access through our Perl API. A particularly interesting thing in these alignments is the ability to switch on the ancestral sequence as well (go to the configuration panel).
More on the use and power of comparative genomics later I hope, but for the moment, do enjoy these displays being back, and do both browse around and download/script against them.
Ewan
The Ensembl project is pleased to announce release 56 of Ensembl (http://www.ensembl.org/). Highlights of this release are:
Reintroduction of our multi-species views. Alignments (image), formerly alignsliceview, shows pairwise or multiple alignments from the Ensembl Compara database, highlighting any gaps in the alignment.
Multi-species view, formerly known as multicontigview, displays pairwise alignments without gaps; multiple pairwise alignments can be configured to create a multiple alignment display. As well as genes, other types of features such as regulatory features can be displayed in this view, making this a very useful display for comparative genomic analysis.
A new tab has been added in release 56 based on a Regulatory Feature object. This will enable better display some of the data underlying the Ensembl regulatory build. The new pages are accessed from the gene displays by clicking on the 'Regulation' link in the left-hand menu and then clicking on a regulatory stable ID in either the image popup menus or the table.
From release 56, users can upload wiggle plot data in WIG and bedGraph formats and view this data on various location-based views. At the moment, only a single style, "wiggle", is available on Region in Detail, whereas a selection of density plots are available on whole chromosome and karyotype images. In addition, Region in Detail now supports greyscale rendering of BED scores via the useScore parameter in the file, and rendering of features in different colours via the itemRgb parameter and per-feature values.
New data in this release includes gene sets on two new species (Pig and Marmoset) and a new gene set on the existing Rat Rnor3.4 assembly. Also in this release is an updated human gene set which includes all the Havana manual annotation in the merge with the Ensembl automatic annotation set. This set represents the Encode project GENCODE 3b gene set. Also included is a new human variation database based on dbSNP 130 and mapped to assembly GRCh37.
For more information on these and other new features in this release visit:
http://www.ensembl.org/info/website/news/index.html
We are currently in the process of releasing Ensembl 56, and should be back online within an hour or so.
Please note that all Ensembl-based sites will be offline at this time whilst we upgrade our user account database. Affected sites include Vega, Pre, the Ensembl archives and the US mirror. Please accept our apologies for any inconvenience caused.
Thanks!
In October Ensembl will feature on 4(!) different continents:
7 Oct: Browser workshop at the Centro de Biologia Molecular Severa Ochoa, Madrid, Spain
9 Oct: Browser workshop at the Instituto de Biologia Molecular e Celular, Porto, Portugal
12-15 Oct: Ensembl module in the Wellcome Trust Open Door Workshop - Working with the Human Genome Sequence, Bangkok, Thailand
20 Oct: Demo for the National Genetics Reference Lab, Manchester, UK
20 Oct: Ensembl module in the Hands-on training at EBI - A dip into EBI resources: understanding your data - New resources and Future Directions, Hinxton, UK
22-23 Oct: Browser workshop at the University of the Witwatersrand, Johannesburg, South Africa
23 Oct: Demo at the ASHG 2009 meeting, Honolulu, Hawaii, US
23 Oct: Developers workshop at the Bejing Genomics Institute at Shenzhen, China
27 Oct: Browser workshop at the Centro Nacional de Investigaciones Oncológicas, Madrid, Spain *postponed to 24 Nov*
27-28 Oct: Browser workshop at Cape Biotech, Cape Town, South Africa
30 Oct - 2 Nov: Developers workshop at the CSHL Genome Informatics 2009 meeting, Cold Spring Harbor, NY, US
For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.
Ensembl announces the release of http://ncbi36.ensembl.org. This Ensembl site is for users who still need access to the NCBI36 human assembly. It is actually a complete copy of the Ensembl 54 release which was the last Ensembl release containing NCBI36.
Although access was already possible through the Ensembl archive sites, the new ncbi36.ensembl.org site will provide better performance because it is running on separate hardware. Also ncbi36.ensembl.org provides Blast/Blat search support which the archives do not.
The main reason we have provided a dedicated site for NCBI36 is for two large projects (Encode and 1000 Genomes) which have some of their data aligned on this assembly. ncbi36.ensembl.org will only be up for as long as there is significant need for it. We will be reviewing usage in Spring 2010 and currently plan to remove the site by Summer 2010. After that time users will still be access the NCBI36 assembly via the archive sites, there just won't be a dedicated site for it anymore.
The Summer holiday time is almost over, so the Ensembl trainers are getting up to speed again in preparation for Autumn, which will be the busiest time of year for them.
The coming month we will have the following Ensembl events:
7 Sep: Demo for the National Genetics Reference Lab, Manchester, UK
7-10 Sep: Ensembl module in the EBI roadshow at the University of Tartu, Tartu, Estonia
16-17 Sep: Browser workshop at the Erasmus MC Molecular Medicine Postgraduate School, Rotterdam, The Netherlands
For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.
Do you want to attend an Ensembl workshop, but are we never coming to your part of the world? Why not see if you can host a workshop at your own university / institute? For more information have a look here or mail us.
If you are in the Western US, we also may still be able to include your university / institute in our Western US tour coming January. Interested? Please mail me for more details.
In addition to Release 2 of Ensembl Genomes early this month, EBI-EMBL would also like to announce the new arrival of Ensembl Fungi (beta).
Release includes:
To our BLAST users,
BLAST is online again, the maintenance is finished.
Thank you for your patience.
The Ensembl team.
We have scheduled some downtime for our BLAST database servers on Monday 10th August *Postponed to Tuesday, 11 Aug*, in order to install some security patches. We will also be trying out an upgrade path and pushing that out to the main BLAST server if it proves compatible. There will be a downtime of between 30 minutes and 12 hours, depending on how smoothly the maintenance goes. The rest of the Ensembl website should be unaffected.
We suggest that you avoid running BLAST or BLAT searches in the 48 hours preceding the maintenance work as we cannot guarantee that data will not be lost. We will update this post as soon as the maintanance has been finished.
Thank you for your patience,
The Ensembl Team
EMBL-EBI is pleased to announce release 2 of Ensembl Genomes; extending Ensembl further across the taxonomic space!
Highlights for this release include:
This year we've invested in our own mirror - maintained by us - on the west coast of the US. This was mainly because assessing the web return time for our users showed a consistent additional 3 to 4 seconds if you were lucky enough to live out on the west coast (worse still if you are in Australia!). Although we did alot last year to improve the general response time of our web pages (for example, compressing our CSS and Javascript down to single files for the whole site, so these are only loaded once and then cach'ed locally), the Ensembl site delivers alot of dynamic content - and nothing but getting closer to the users can help this.
You can reach the site directly at uswest.ensembl.org or alternatively there is a little "world" icon on the top right of the page which switches to the star-and-stripes when you're on the west coast. Having the mirror not only helps our users who are on the west coast but also provides resilience when our main site goes down. As we're responsibile for provisioning it in-sync with our main site (its part of our release process) this mirror will stay current with the main site.
In some sense the mirror should be a low cost "per user" for us having the mirror - if users go to the mirror, it means less load on the main site, and so it's really how we distribute the "web farm" that sits behind Ensembl geographically. However, there are overheads from hiring rack space in the US to making our own release cycle more complex. This means we will need to assess whether running a US mirror makes sense in the long term. Our instinct is yes, but we need hard data on this.
These things need time to pick up, but already we'd be interested in feedback on this - for US users, is this site faster for you - in particular for East coast people who we think are probably still best off on the main site. Does it change with time of day? For Pacific rim users - Japan, Singapore, Korea, Australia - is the west coast site snappier for you? We'll be putting in place our own monitoring schemes, but user feedback is always good...
The Ensembl Outreach team is currently looking into the possibility of giving some 1-day Ensembl browser workshops in the Western US in the period directly after the Plant and Animal Genome Conference in San Diego, which takes place from 9-13 January 2010. Hosting institutions would only have to pay the instructor's expenses (accommodation and subsistence) and would share the domestic travel costs, but we would not otherwise charge for the workshops.
For more information about our browser workshops, please have a look here.
Interested? Please contact me for more details at bert@ebi.ac.uk.
The Ensembl project is pleased to announce release 55 of Ensembl. Highlights of this release are:
* New GRCh37 human assembly;
* Wallaby 2x genome;
* Ability to display uploaded data on individual chromosomes or whole karyotype.
For more information visit our What's New page.
Release 55 has lots of goodies - not least the new, coordinated, GRCh37 assembly (more on that later), but one addition is the Martability of Ensembl Regulatory Features. Regulatory features are on by default on Human and Mouse, and each gene has a specific page for the regulatory features (for example http://www.ensembl.org/Homo_sapiens/Gene/Regulation?g=ENSG00000139618). Regulatory Features are developing fast, and the Martability is bringing out the richer information in the functional genomics database - for example, the classification of features into "promoter", "gene associated" and "unclassified". Next release we're hoping to release a more graphical view for each feature, but the present of the regulatory features in Mart allows the large scale users - from Perl, Java, R or just plain-only tab delimited text - to use them.
We're expecting alot of development in this area - the addition of Mouse DNaseI sites has allowed us to develop a Mouse build, and of course, the ENCODE project which is now on line in production mode will provide a far richer, deeper, dataset to work against.
So - watch this space.