25 January, 2010

Calling all Americans (and Australians/NZ/Pacific Rim...)

For about 3 weeks now researchers in the US have had their default Ensembl go to our US west mirror (uswest.ensembl.org) automatically - if you just go to www.ensembl.org you brower gets automatically redirected. The US joined Japan and Canada who we switched in late 2009.

From our perspective, this is all working fine; the usage of uswest has gone up, and IP tracking on that shows far more US IP addresses (so the redirect is working fine!). We get some 3,000 odd visits a day, with some 50,000 pages delivered from our uswest site - about 20% of our total hits. Brilliant.

What is slightly more surprising is that we're not getting any queries on this. Given the usage, we think this means the default browser, content and other functionality must be working well (or Americans are very shy about complaining... but that doesn't sound like a good description of all Americans...). But we'd also like to hear from American users - have you noticed ensembl "go faster?". Are there any glitches?

Another issue we are unclear about is whether we should automatically shift other users on the Pacific Rim to automatically go to uswest - in terms of usage, the biggest country would be Australia, but New Zealand, Phillipines and other Pacific Rim countries would also be candidates. It's quite hard for us to assess whether our Europe (Cambridge UK) based servers or US west servers are best for this - both latency and throughput changes on different routes, and the time zone shift makes things complex to assess systematically in an easy way.


So - feedback welcome - either on this post or to helpdesk@ensembl.org about what your experience is, either from the US or from the pacific rim.

22 January, 2010

Ensembl Events in February 2010

In February we will have the following Ensembl events:

3-4 Feb: Ensembl module in the EBI Bioinformatics Roadshow at the University of Aberdeen, Aberdeen, UK
11 Feb: Browser workshop for the NHS at Western General Hospital, Edinburgh, UK
11-12 Feb: Browser workshop at the University of Cambridge, Cambridge, UK
16-18 Feb: Ensembl module in the EBI Bioinformatics Roadshow at the Jozef Stefan Institute and University of Ljubljana, Ljubljana, Slovenia
22-26 Feb: Ensembl API module in the Hands-on training at EBI - Programmatic Access To Biological Databases (Perl), Hinxton, UK

For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.

16 December, 2009

Ensembl Events in January 2010

For the beginning of the new year we have the following Ensembl events lined up:

9-13 Jan: Ensembl & Ensembl Genomes demo at the Plant and Animal Genome Conference XVIII, San Diego, CA, US
19-20 Jan: Ensembl module in the EBI Bioinformatics Roadshow at City of Hope, Duarte, CA, US
25-27 Jan: Ensembl module in the EBI Tools for Genomics and Proteomics workshop at the Moroccan Society of Bioinformatics, Tangier, Morocco
28 Jan: Browser workshop at the University of Nottingham, Nottingham, UK

For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.

10 December, 2009

New on Pre!

Updated elephant and gorilla genomes are now available on the Ensembl Pre! site.

They will be released in full with annotated gene sets in Ensembl 57 (due spring 2010). The new gorilla assembly (gorGor2) includes short-read and capillary sequences. The elephant genome (Loxafr3.0) was also updated, and is at 7x coverage. The 57 release will present new genebuilds for both species.

08 December, 2009

Release 57 rescheduled

Ensembl release 57 has been rescheduled for mid to late February 2010.

We had originally planned for release 57 to be this week, but our final quality checks identified a significant error in the unreleased data set. Because of this, we feel that our users would be better served by rescheduling the release to ensure that we provide the best possible data resources for the community.

On behalf of everyone in the project, thank you for your continued support of Ensembl and we wish you all the very best for the holiday season and the new year.

27 November, 2009

BLAST problems

BLAST should be available again - following the recent scripting, the server hard drive had filled up, so that it was unable to process any more requests. We have cleared some space, so the server is now able to accept tickets once again.

Please accept our apologies for the continued downtime.

24 November, 2009

SNP consequences

Did you know that you can use the ensembl API to predict the consequences of your own SNP positions? This is a really popular question and there is some example code on the website to guide you through this. See an example here. This functionality is available from ensembl release 56 but we have also recently patched release 54 in case you need to use the NCBI 36 human assembly.
Soon there will be a page on the website where you can upload your data and we will project SNP consequences for you.

BLAST back online

Our BLAST/BLAT service has been re-enabled, following a problem with the server hosting the BLAT logs which has now been fixed. Thank you for your patience.

23 November, 2009

Ensembl Events in December 2009

After two extremely busy months things are getting quieter again on the Ensembl training front. For December we have the following events scheduled:

3 Dec: Browser workshop for Master's students at University College London, London, UK
9 Dec: Browser workshop at Addenbrookes Hospital, Cambridge, UK

For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.

20 November, 2009

BLAST unavailable

We have had to disable BLAST temporarily owing to excessive load on the servers. The service will be enabled as soon we have analysed the problem.

17 November, 2009

BLAST back online

We have now repaired the BLAST database and the service is once more available. We will be monitoring the situation, but hopefully no further action will be required.

Please accept our apologies for any inconvenience caused.

16 November, 2009

BLAST unavailable

We regret that owing to problems with our BLAST server, we have had to disable this feature temporarily, as issues with tickets were bringing down the whole Ensembl website. We will endeavour to have BLAST back online as soon as possible; please accept our apologies for any inconvenience caused.

22 October, 2009

Ensembl Events in November 2009

October was quite a busy month for the Ensembl Outreach team, but November is even busier:

2 Nov: Developers workshop at the German Cancer Research Center (DKFZ), Heidelberg, Germany
4-10 Nov: Ensembl module in the Computational & Comparative Genomics course, Cold Spring Harbor, NY, US
5-6 Nov: Ensembl Genomes module in the EBI Roadshow at the University of Szeged, Hungary
9 Nov: Browser workshop at the German Cancer Research Center (DKFZ), Heidelberg, Germany
10 Nov: Browser workshop at the German Cancer Research Center (DKFZ), Heidelberg, Germany
12-13 Nov: Browser workshop at the University of Cambridge, Cambridge, UK
12 Nov: Browser workshop at the Jackson Laboratory, Bar Harbor, ME, US
13 Nov: Browser workshop at the Jackson Laboratory, Bar Harbor, ME, US
13 Nov: Presentation at the Jackson Laboratory, Bar Harbor, ME, US
16 Nov: Browser workshop at Harvard Medical School, Boston, MA, US
17-18 Nov: Ensembl module in The Genome Access Course, Cold Spring Harbor, NY, US
18 Nov: Presentation for EBI/EMBL Ph.D. students, Hinxton, UK
24 Nov: Browser workshop at the Centro Nacional de Investigaciones Oncológicas, Madrid, Spain
26-27 Nov: Developers workshop at the Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland
26 Nov: Browser workshop at the Royal Veterinary College, London, UK
28 Nov: Browser workshop at CEINGE Biotecnologie Avanzate, Naples, Italy
30 Nov - 1 Dec: Ensembl module in the Wellcome Trust Open Door Workshop - Working with the Human Genome Sequence, Hinxton, UK
30 Nov - 2 Dec: Developers workshop at the University of Cambridge, Cambridge, UK

For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.

19 October, 2009

Aloha ASHG

From this little corner of the world Ensembl will be delivering an Interactive Workshop on Friday (October 23rd) from noon (12.00) in Room 315 in the Convention Center. If you want to attend, let us know as seating is restricted and we are allocating seats until the room is full. You must bring a laptop with a wireless card (and a fully charged battery).

Furthermore, you can also visit us on booth 432 where we will be happy to help you and get any feedback.
Mahalo

08 October, 2009

Ensembl Genomes Release 3

We are pleased to announce the third release of EnsemblGenomes, which includes the first release of two new Ensembl-based portals, Ensembl Plants and Ensembl Fungi.

These complete the span of Ensembl Genomes portals across the taxonomic space, complementing the coverage of vertebrate genomes available through Ensembl.

  • Ensembl Plants has been built in collaboration with Gramene and includes the genomes of six monocots and two dicots. Variation databases are available for four of these species.
  • Ensembl Fungi includes a new build of the Sacchromyces cerevisiae genome using the latest data from SGD, including variation data derived from the Saccharomyces Genome Resequencing Project; and Ensembl databases for Schizosaccharomyces pombe (built in collaboration with GeneDB_Spombe) and eight species of Aspergillus (built in collaboration with the Central Aspergillus Database Repository, CADRE).
  • User upload databases are now operational for Ensembl Protists, Fungi, Plants and Metazoa, allowing users to visualise their own data in the Ensembl environment.
Ensembl Genomes release 3 has been built using Ensembl 55 software. We aim to synchronise with Ensembl with our next release (Ensembl Genomes 4/Ensembl 57), and to stay synchronised thereafter.

01 October, 2009

Genomewide comparative displays

When we changed our look and feel almost a year ago, we "left behind" our two main graphical genome-wide comparative genomics displays (our textual comparative genomics displays remains, as did some of the gene centric ones). These were some of the most complex displays, not only in the graphics layout but also in aspects such as configuration - with comparative genomics tracks with up to 30 species, potentially one has the union of all tracks in each species, and doing this consistently required reworking how we thought about the "same" or "different" tracks across species.

It's taken longer than we thought it would, but finally in release 56 these displays are back and better than ever. With more aggressive caching of data items as they head to the web (and, in addition, if you are on the west coast of the US or the Pacific Rim, check out the US west mirror at uswest.ensembl.org) they go far faster, making them far more useable.

We have two fundamentally different ways of thinking about genomic alignments.

In "Multi Sequence View", which works fundamentally as a set of pairwise alignments, we maintain the linear sequence of each genome, and then draw regions which are conserved between them. Check out displays like:

Mouse/Human

And make sure you hit "Configure Page" and in the Comparative Genomics section, switch on blastz. I also like to have genes in "Collapsed, labels" (so alternative splicing doesn't produce excessive displays) and also switch on Regulatory Features.

Now - you get a nice picture of this region in human and mouse. The orthologous gene (PECI) has conserved exons, and the regulatory features at the start of this gene is conserved in human and mouse and both cases classified as a promoter. All as expected.

But a closer look shows that the transcript going by the catchy name of AC123437.5 in mouse, going on the opposite strand has some of its exons overlapping to the human PECI, and Human PECI is duplicated into two local genes here. This is perhaps easier to see as one zooms out in this display (notice you can drag-and-select in the upper panels, or use the + and - bars to change in the lower panels)

Zoom Out

In contrast, the alignment (Image) view, asks you to choose one species as the co-linear
reference, and then the other species are organised specifically by the alignment of that
reference. This is ideal in more linear, orthologous regions. I like using the 10-way EPO alignment for visualisation/gene model comparison, although to go things like conservation analysis, you want to use the 31-way mammalian alignment with the low coverage data

This is gene, well conserved across mammals.

Co Linear

We can look at the precisely the same alignment from the perpsective of Mouse, Rat, Dog, Horse, Human, Pig. In each case, the alignment is unbiased to each species. For example, the Mouse-Rat portion of this multiple alignment still aligns the unique rodent portions.

Here is that same region from the perspective of Cow:

Cow

Notice when you go to human you have a choice of not only 4 different multiple alignments - a 4-way primate alignment, a 10-way mammalian alignment, a 12-way alignment including chicken and 31-way mammalian alignment, but also 40 odd other individual pairwise alignments.

In each case, you can get the alignment out as text - here's a 4-way primate alignment:

Text alignment

or the same region in a 31-way glory

31 one way text


Of course, all this information is also available to download or access through our Perl API. A particularly interesting thing in these alignments is the ability to switch on the ancestral sequence as well (go to the configuration panel).


More on the use and power of comparative genomics later I hope, but for the moment, do enjoy these displays being back, and do both browse around and download/script against them.


Ewan


29 September, 2009

Release 56

The Ensembl project is pleased to announce release 56 of Ensembl (http://www.ensembl.org/). Highlights of this release are:

Reintroduction of our multi-species views. Alignments (image), formerly alignsliceview, shows pairwise or multiple alignments from the Ensembl Compara database, highlighting any gaps in the alignment.

Multi-species view, formerly known as multicontigview, displays pairwise alignments without gaps; multiple pairwise alignments can be configured to create a multiple alignment display. As well as genes, other types of features such as regulatory features can be displayed in this view, making this a very useful display for comparative genomic analysis.

A new tab has been added in release 56 based on a Regulatory Feature object. This will enable better display some of the data underlying the Ensembl regulatory build. The new pages are accessed from the gene displays by clicking on the 'Regulation' link in the left-hand menu and then clicking on a regulatory stable ID in either the image popup menus or the table.

From release 56, users can upload wiggle plot data in WIG and bedGraph formats and view this data on various location-based views. At the moment, only a single style, "wiggle", is available on Region in Detail, whereas a selection of density plots are available on whole chromosome and karyotype images. In addition, Region in Detail now supports greyscale rendering of BED scores via the useScore parameter in the file, and rendering of features in different colours via the itemRgb parameter and per-feature values.

New data in this release includes gene sets on two new species (Pig and Marmoset) and a new gene set on the existing Rat Rnor3.4 assembly. Also in this release is an updated human gene set which includes all the Havana manual annotation in the merge with the Ensembl automatic annotation set. This set represents the Encode project GENCODE 3b gene set. Also included is a new human variation database based on dbSNP 130 and mapped to assembly GRCh37.


For more information on these and other new features in this release visit:

http://www.ensembl.org/info/website/news/index.html

28 September, 2009

Ensembl website downtime

We are currently in the process of releasing Ensembl 56, and should be back online within an hour or so.

Please note that all Ensembl-based sites will be offline at this time whilst we upgrade our user account database. Affected sites include Vega, Pre, the Ensembl archives and the US mirror. Please accept our apologies for any inconvenience caused.

Thanks!

18 September, 2009

Ensembl events in October 2009

In October Ensembl will feature on 4(!) different continents:

7 Oct: Browser workshop at the Centro de Biologia Molecular Severa Ochoa, Madrid, Spain
9 Oct: Browser workshop at the Instituto de Biologia Molecular e Celular, Porto, Portugal
12-15 Oct: Ensembl module in the Wellcome Trust Open Door Workshop - Working with the Human Genome Sequence, Bangkok, Thailand
20 Oct: Demo for the National Genetics Reference Lab, Manchester, UK
20 Oct: Ensembl module in the Hands-on training at EBI - A dip into EBI resources: understanding your data - New resources and Future Directions, Hinxton, UK
22-23 Oct: Browser workshop at the University of the Witwatersrand, Johannesburg, South Africa
23 Oct: Demo at the ASHG 2009 meeting, Honolulu, Hawaii, US
23 Oct: Developers workshop at the Bejing Genomics Institute at Shenzhen, China
27 Oct: Browser workshop at the Centro Nacional de Investigaciones Oncológicas, Madrid, Spain *postponed to 24 Nov*
27-28 Oct: Browser workshop at Cape Biotech, Cape Town, South Africa
30 Oct - 2 Nov: Developers workshop at the CSHL Genome Informatics 2009 meeting, Cold Spring Harbor, NY, US

For details about these and other upcoming events, please have a look at the complete list of Ensembl training events.

15 September, 2009

NCBI36 Ensembl Site

Ensembl announces the release of http://ncbi36.ensembl.org. This Ensembl site is for users who still need access to the NCBI36 human assembly. It is actually a complete copy of the Ensembl 54 release which was the last Ensembl release containing NCBI36.

Although access was already possible through the Ensembl archive sites, the new ncbi36.ensembl.org site will provide better performance because it is running on separate hardware. Also ncbi36.ensembl.org provides Blast/Blat search support which the archives do not.

The main reason we have provided a dedicated site for NCBI36 is for two large projects (Encode and 1000 Genomes) which have some of their data aligned on this assembly. ncbi36.ensembl.org will only be up for as long as there is significant need for it. We will be reviewing usage in Spring 2010 and currently plan to remove the site by Summer 2010. After that time users will still be access the NCBI36 assembly via the archive sites, there just won't be a dedicated site for it anymore.