library(AnnotationHub)
library(AnnotationDbi)
library(ensembldb)
library(DESeq2)
library(tidyverse)
Before starting this section, we will make sure we have all the relevant objects from the Differential Expression analysis.
ddsObj.interaction <- readRDS("RObjects/DESeqDataSet.interaction.rds")
results.interaction.11 <- readRDS("RObjects/DESeqResults.interaction_d11.rds")
results.interaction.33 <- readRDS("RObjects/DESeqResults.interaction_d33.rds")
We have a list of significantly deferentially expressed genes, but the only annotation we can see is the Ensembl Gene ID, which is not very informative.
There are a number of ways to add annotation. One method is to do this using a Bioconductor annotation package. These packages which are re-built every periodically with the latest annotations. These packages are listed on the annotation section of the Bioconductor, and are installed in the same way as regular Bioconductor packages.
An another approach is to use biomaRt
, an interface to the BioMart resource. Using BioMart ensures that you are able to get the latest annotations for the GeneIDs, and can match the version of the gene annotation that was used for read counting.
A third method is to use AnnotationHub
, this is like the bioconductor packages but in an online database like bioMaRt
. They keep them slightly more up to date than the standard bioconductor packages and each time you use them the results are cached on your machine.
Today we will use the AnnotationHub
method. A workflow for annotation with biomaRt is included in the extended materials section accessible on the course website.
First we need to get the correct database from AnnotationHub
. We make the instance (the first time we do this it will create a local cache on your machine so that repeat queries are very quick).
As you can see ah
contains huge amounts of information and it is constantly changing. This is why it gives us the snapshot date so we know when our cached version is from. The ah
object actually online contains pointers to where all the information is online and we don’t want to download all of them as it would take a very long time and we don’t need all of it.
This object is a vector and you can get information about a single resource by indexing with a single bracket [
or download a resource with a double bracket [[
.
# create an annotationhub instance
ah <- AnnotationHub()
ah
## AnnotationHub with 71082 records
## # snapshotDate(): 2023-10-23
## # $dataprovider: Ensembl, BroadInstitute, UCSC, ftp://ftp.ncbi.nlm.nih.gov/g...
## # $species: Homo sapiens, Mus musculus, Drosophila melanogaster, Rattus norv...
## # $rdataclass: GRanges, TwoBitFile, BigWigFile, EnsDb, Rle, OrgDb, SQLiteFil...
## # additional mcols(): taxonomyid, genome, description,
## # coordinate_1_based, maintainer, rdatadateadded, preparerclass, tags,
## # rdatapath, sourceurl, sourcetype
## # retrieve records with, e.g., 'object[["AH5012"]]'
##
## title
## AH5012 | Chromosome Band
## AH5013 | STS Markers
## AH5014 | FISH Clones
## AH5015 | Recomb Rate
## AH5016 | ENCODE Pilot
## ... ...
## AH116479 | Ensembl 111 EnsDb for Xiphophorus maculatus
## AH116480 | Ensembl 111 EnsDb for Xenopus tropicalis
## AH116481 | Ensembl 111 EnsDb for Zonotrichia albicollis
## AH116482 | Ensembl 111 EnsDb for Zalophus californianus
## AH116483 | Ensembl 111 EnsDb for Zosterops lateralis melanops
ah[1]
## AnnotationHub with 1 record
## # snapshotDate(): 2023-10-23
## # names(): AH5012
## # $dataprovider: UCSC
## # $species: Homo sapiens
## # $rdataclass: GRanges
## # $rdatadateadded: 2013-03-26
## # $title: Chromosome Band
## # $description: GRanges object from UCSC track 'Chromosome Band'
## # $taxonomyid: 9606
## # $genome: hg19
## # $sourcetype: UCSC track
## # $sourceurl: rtracklayer://hgdownload.cse.ucsc.edu/goldenpath/hg19/database...
## # $sourcesize: NA
## # $tags: c("cytoBand", "UCSC", "track", "Gene", "Transcript",
## # "Annotation")
## # retrieve record with 'object[["AH5012"]]'
# Download the database we want to use
MouseEnsDb <- query(ah, c("EnsDb", "Mus musculus", "102"))[[1]]
This database contains the entire gene annotation from Ensembl release 102 for mouse. It includes descriptions of genes, transcripts, exons, UTRs etc.
We can turn the whole gene-level annotation table into a data frame so we can work with it using the tidyverse suite of tools.
annotations <- genes(MouseEnsDb, return.type = "data.frame")
# lets see what information we have
colnames(annotations)
## [1] "gene_id" "gene_name" "gene_biotype"
## [4] "gene_seq_start" "gene_seq_end" "seq_name"
## [7] "seq_strand" "seq_coord_system" "description"
## [10] "gene_id_version" "canonical_transcript" "symbol"
## [13] "entrezid"
annot <- annotations %>%
select(gene_id, gene_name, entrezid) %>%
filter(gene_id %in% rownames(results.interaction.11))
NOTE: You may get an error with this command that looks like:
Error in (function (classes, fdef, mtable) :
unable to find an inherited method for function 'select' for signature '"data.frame"'
This is due to the select
function from dplyr (part of tidyverse) being masked by the select
function from one of the annotation packages. This will have happened because the annotation package was loaded after the tidyverse. You can either restart your R session and reload the required packages, this time being sure to load tidyverse last, or just use dplyr::select
to explicitly use the select
function from dplyr:
annot <- annotations %>%
dplyr::select(gene_id, gene_name, entrezid) %>%
dplyr::filter(gene_id %in% rownames(results.interaction.11))
Let’s inspect the annotation.
head(annot)
## gene_id gene_name entrezid
## 1 ENSMUSG00000051951 Xkr4 497097
## 2 ENSMUSG00000025900 Rp1 19888
## 3 ENSMUSG00000025902 Sox17 20671
## 4 ENSMUSG00000102269 Gm7357 NA
## 5 ENSMUSG00000103922 Gm6123 NA
## 6 ENSMUSG00000033845 Mrpl15 27395
length(annot$entrezid)
## [1] 20091
length(unique(annot$entrezid))
## [1] 17278
sum(is.na(annot$entrezid)) # Why are there NAs in the ENTREZID column?
## [1] 2782
Gene/transcript/protein IDs mapping between different databases not always perfect. Although majority of IDs map between databases, small subset may not have matching ID or may have more than one match. This is because feature identification algorithms, naming methodologies and versions may differ among databases. For instance NCBI and HGNC give same ID for different gene versions, whereas Ensembl assigned separate IDs for gene versions. Read interesting discussion on biostars.
There are some Ensembl IDs with no EntrezID. These gene ids has no corresponding Entrez ID in the EnsDb
database package. The Ensembl and Entrez databases don’t match on a 1:1 level although they have started taking steps towards consolidating in recent years.
To ensure everyone is working with same annotation, we have created an annotation table.
In this case we used the biomaRt
package to download annotations directly from Ensembl. In this cases we can get additional columns, but will also sometimes get one-to-many relationships, where one Ensembl ID maps to multiple Entrez IDs. This sort of problem is common when mapping between annotation sources, but they have already been dealt with for us in AnnotationHub. If we wanted more control over this we would need to manually curate these one-to-many relationships ourselves.
In annotation table below we have modified the column names and dealt with the one-to-many/missing issues for Entrez IDs. The code we used for doing this is available in the extended materials section.
We will load out pre-created annotation table, and then combine it with our results table.
ensemblAnnot <- readRDS("RObjects/Ensembl_annotations.rds")
colnames(ensemblAnnot)
## [1] "GeneID" "Entrez" "Symbol" "Description" "Biotype"
## [6] "Chr" "Start" "End" "Strand"
annot.interaction.11 <- as.data.frame(results.interaction.11) %>%
rownames_to_column("GeneID") %>%
left_join(ensemblAnnot, "GeneID")
NOTE: If you had the issue earlier with select
being masked and you used the dplyr::select
solution, you will also have an issue rename
and will need to use dplyr::rename
.
Finally we can output the annotation DE results using write_tsv
.
write_tsv(annot.interaction.11, "results/Interaction.11_Results_Annotated.txt")
A quick and easy “sanity check” for our DE results is to generate a p-value histogram. What we should see is a high bar at 0 - 0.05
and then a roughly uniform tail to the right of this. There is a nice explanation of other possible patterns in the histogram and what to do when you see them in this post.
hist(annot.interaction.11$pvalue)
DESeq2
provides a function called lfcShrink
that shrinks log-Fold Change (LFC) estimates towards zero using and empirical Bayes procedure. The reason for doing this is that there is high variance in the LFC estimates when counts are low and this results in lowly expressed genes appearing to show greater differences between groups than highly expressed genes. The lfcShrink
method compensates for this and allows better visualisation and ranking of genes. We will use it for our visualisation of the data.
ddsShrink.11 <- lfcShrink(ddsObj.interaction,
res = results.interaction.11,
type = "ashr")
## using 'ashr' for LFC shrinkage. If used in published research, please cite:
## Stephens, M. (2016) False discovery rates: a new deal. Biostatistics, 18:2.
## https://doi.org/10.1093/biostatistics/kxw041
shrinkTab.11 <- as.data.frame(ddsShrink.11) %>%
rownames_to_column("GeneID") %>%
left_join(ensemblAnnot, "GeneID")
MA plots are a common way to visualize the results of a differential analysis. We met them briefly towards the end of the DESeq2 session. This plot shows the log-Fold Change for each gene against its average expression across all samples in the two conditions being contrasted. DESeq2
has a handy function for plotting this. Let’s use it too compare the shrunk and un-shrunk fold changes.
par(mfrow=c(1,2))
plotMA(results.interaction.11, alpha=0.05)
plotMA(ddsShrink.11, alpha=0.05)
The DESeq2 in plotMA
function is fine for a quick look, but these inbuilt functions aren’t easy to customise, make changes to the way it looks or add things such as gene labels. For this we would recommend using the ggplot package.
Another common visualisation is the volcano plot which displays a measure of significance on the y-axis and fold-change on the x-axis. We will use ggplot to create this.
ggplot2
The ggplot2
package has emerged as an attractive alternative to the traditional plots provided by base R. A full overview of all capabilities of the package is available from the cheatsheet.
In brief:-
shrinkTab.11
is our data frame containing the variables we wish to plotaes
creates a mapping between the variables in our data frame to the aesthetic properties of the plot:
log2FoldChange
-log10(pvalue)
geom_point
specifies the particular type of plot we want (in this case a scatter plot)geom_text
allows us to add labels to some or all of the points
The real advantage of ggplot2
is the ability to change the appearance of our plot by mapping other variables to aspects of the plot. For example, we could colour the points based on the sample group. To do this we can add metadata from the sampleinfo
table to the data. The colours are automatically chosen by ggplot2
, but we can specify particular values. For the volcano plot we will colour according whether the gene has a pvalue below 0.05. We use a -log10
transformation for the y-axis; it’s commonly used for p-values as it means that more significant genes have a higher scale.
ggplot(shrinkTab.11, aes(x = log2FoldChange, y = -log10(pvalue))) +
geom_point(aes(colour = padj < 0.05), size=1) +
geom_text(data = ~top_n(.x, 1, wt = -padj), aes(label = Symbol)) +
labs(x = "log2(fold change)", y = "-log10(p-value)", colour = "FDR < 5%",
title = "Infected vs Uninfected (day 11)")
## Warning: Removed 47 rows containing missing values or values outside the scale
## range (`geom_point()`).
We just made the volcano plot for the 11 days contrast, you will make the one for the 33 days contrast.
If you haven’t already make sure you load in our data and annotation. You can copy and paste the code below.
# First load data and annotations
results.interaction.33 <- readRDS("RObjects/DESeqResults.interaction_d33.rds")
ensemblAnnot <- readRDS("RObjects/Ensembl_annotations.rds")
- Shrink the results for the 33 days contrast.
## using 'ashr' for LFC shrinkage. If used in published research, please cite:
## Stephens, M. (2016) False discovery rates: a new deal. Biostatistics, 18:2.
## https://doi.org/10.1093/biostatistics/kxw041
- Create a plot with points coloured by padj < 0.05 similar to how we did in the first volcano plot
- Compare these two volcano plots, what differences can you see between the two contrasts?
For this exercise create an MA plot for day 33 like the ones we plotted with
plotMA
from DESeq2 but this time using ggplot2.The x-axis should be the log2 of the mean gene expression across all samples, and the y-axis should be the log2 of the fold change between Infected and Uninfected.
Before following up on the DE genes with further lab work, a recommended sanity check is to have a look at the expression levels of the individual samples for the genes of interest. We can quickly look at grouped expression by using plotCounts
function of DESeq2
to retrieve the normalised expression values from the ddsObj
object and then plotting with ggplot2
.
We are going investigate the Il10ra gene:
geneID <- filter(shrinkTab.11, Symbol=="Il10ra") %>% pull(GeneID)
plotCounts(ddsObj.interaction,
gene = geneID,
intgroup = c("TimePoint", "Status", "Replicate"),
returnData = T) %>%
ggplot(aes(x=Status, y=log2(count))) +
geom_point(aes(fill=Replicate), shape=21, size=2) +
facet_wrap(~TimePoint) +
expand_limits(y=0) +
labs(title = "Normalised counts - Interleukin 10 receptor, alpha")
For this exercise create another strip chart for the gene Jchain.
In the paper you may notice they have presented a Venn diagram of the results.
We will recreate it with our analysis. To do this we are using the package ggvenn
which is an extension to ggplot
from Linlin Yan.
library(ggvenn)
## Loading required package: grid
First we have to prepare the data with a column for each set we want in the Venn. The final table should look like this:
## # A tibble: 20,091 × 5
## Geneid Upregulated_11 Downregulated_11 Upregulated_33 Downregulated_33
## <chr> <lgl> <lgl> <lgl> <lgl>
## 1 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 2 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 3 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 4 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 5 ENSMUSG00000… FALSE FALSE FALSE TRUE
## 6 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 7 ENSMUSG00000… TRUE FALSE TRUE FALSE
## 8 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 9 ENSMUSG00000… FALSE FALSE FALSE FALSE
## 10 ENSMUSG00000… FALSE FALSE FALSE FALSE
## # ℹ 20,081 more rows
The first column contains the gene ids. The remaining columns are the four sets that we want to plot on the venn diagram:
These columns contain logical vectors (TRUE/FALSE) that indicate when or not the gene is included in that set.
vennDat <- tibble(Geneid=rownames(results.interaction.11)) %>%
mutate(Upregulated_11 = results.interaction.11$padj < 0.05 &
!is.na(results.interaction.11$padj) &
results.interaction.11$log2FoldChange > 0) %>%
mutate(Downregulated_11 = results.interaction.11$padj < 0.05 &
!is.na(results.interaction.11$padj) &
results.interaction.11$log2FoldChange < 0) %>%
mutate(Upregulated_33 = results.interaction.33$padj < 0.05 &
!is.na(results.interaction.33$padj) &
results.interaction.33$log2FoldChange > 0) %>%
mutate(Downregulated_33 = results.interaction.33$padj < 0.05 &
!is.na(results.interaction.33$padj) &
results.interaction.33$log2FoldChange < 0)
ggvenn(vennDat, set_name_size = 4)
We’re going to use the package ComplexHeatmap
(Gu, Eils, and Schlesner 2016). We’ll also use circlize
to generate a colour scale (Gu et al. 2014).
library(ComplexHeatmap)
library(circlize)
We can’t plot the entire data set, let’s just select the top 300 by false discovery rate (padj
). We’ll want to use normalised expression values, so we’ll use the vst
function.
# get the top genes
sigGenes <- shrinkTab.11 %>%
top_n(300, wt = -padj) %>%
pull("GeneID")
# filter the data for the top 300 by padj
plotDat <- vst(ddsObj.interaction)[sigGenes,] %>%
assay()
The range expression values for different genes can vary widely. Some genes will have very high expression. Our heatmap is going to be coloured according to gene expression. If we used a colour scale from 0 (no expression) to the maximum expression, the scale will be dominated by our most extreme genes and it will be difficult to discern any difference between most of the genes.
To overcome this we will z-scale the counts. This scaling method results in values for each that show the number of standard deviations the gene expression is from the mean for that gene across all the sample - the mean will be ‘0’, ‘1’ means 1 standard deviation higher than the mean, ‘-1’ means 1 standard deviation lower than the mean.
z.mat <- t(scale(t(plotDat), center=TRUE, scale=TRUE))
# colour palette
myPalette <- c("royalblue3", "ivory", "orangered3")
myRamp <- colorRamp2(c(-2, 0, 2), myPalette)
Heatmap(z.mat, name = "z-score",
col = myRamp,
show_row_names = FALSE)
we can also split the heat map into clusters and add some annotation.
ha1 = HeatmapAnnotation(df = colData(ddsObj.interaction)[,c("Status", "TimePoint")])
Heatmap(z.mat, name = "z-score",
col = myRamp,
show_row_name = FALSE,
split=3,
rect_gp = gpar(col = "lightgrey", lwd=0.3),
top_annotation = ha1)
Whenever we teach this session several student always ask how to set the colours of the bars at the top of the heatmap. This is shown below.
ha1 = HeatmapAnnotation(df = colData(ddsObj.interaction)[,c("Status", "TimePoint")],
col = list(Status = c("Uninfected" = "darkgreen",
"Infected" = "palegreen"),
TimePoint = c("d11" = "lightblue",
"d33" = "darkblue")))
Heatmap(z.mat, name = "z-score",
col = myRamp,
show_row_name = FALSE,
split=3,
rect_gp = gpar(col = "lightgrey", lwd=0.3),
top_annotation = ha1)
saveRDS(annot.interaction.11, file="results/Annotated_Results.d11.rds")
saveRDS(shrinkTab.11, file="results/Shrunk_Results.d11.rds")
saveRDS(annot.interaction.33, file="results/Annotated_Results.d33.rds")
saveRDS(shrinkTab.33, file="results/Shrunk_Results.d33.rds")
Gu, Zuguang, Roland Eils, and Matthias Schlesner. 2016. “Complex Heatmaps Reveal Patterns and Correlations in Multidimensional Genomic Data.” Bioinformatics.
Gu, Zuguang, Lei Gu, Roland Eils, Matthias Schlesner, and Benedikt Brors. 2014. “Circlize Implements and Enhances Circular Visualization in R.” Bioinformatics 30 (19): 2811–2.