Original Authors: Belinda Phipson, Anna Trigos, Matt Ritchie, Maria Doyle, Harriet Dashnow, Charity Law Based on the course RNAseq analysis in R delivered on May 11/12th 2016

Resources and data files

This material has been created using the following resources:
http://www.statsci.org/smyth/pubs/QLedgeRPreprint.pdf (Lun, Chen, and Smyth 2016)
http://monashbioinformaticsplatform.github.io/RNAseq-DE-analysis-with-R/99-RNAseq_DE_analysis_with_R.html

Data files downloaded from:
ftp://ftp.ncbi.nlm.nih.gov/geo/series/GSE60nnn/GSE60450/suppl/GSE60450_Lactation-GenewiseCounts.txt.gz http://bioinf.wehi.edu.au/software/MSigDB/mouse_c2_v5.rdata http://bioinf.wehi.edu.au/software/MSigDB/mouse_H_v5.rdata

Data files:
sampleinfo.txt
GSE60450_Lactation-GenewiseCounts.txt
mouse_c2_v5.rdata
mouse_H_v5.rdata

Data files available from: https://figshare.com/s/1d788fd384d33e913a2a You should download these files and place them in your /data directory.

Differential expression with edgeR

Now that we are happy that we have normalised the data and that the quality looks good, we can continue to testing for differentially expressed genes. There are a number of packages to analyse RNA-Seq data. Most people use DESEQ2 or edgeR. We will use edgeR for the rest of this practical.

**First make sure we have all the objects and libraries loaded*

library(edgeR)
library(limma)
library(Glimma)
library(gplots)
library(org.Mm.eg.db)
load("Robjects/preprocessing.Rdata")

Recap of pre-processing

The previous section walked-through the pre-processing and transformation of the count data. Here, for completeness, we list the minimal steps required to process the data prior to differential expression analysis.

## Read the counts from the downloaded data
seqdata <- read.delim("data/GSE60450_Lactation-GenewiseCounts.txt", stringsAsFactors = FALSE)
#
# Remove first two columns from seqdata

countdata <- seqdata[,-(1:2)]

# Store EntrezGeneID as rownames
rownames(countdata) <- seqdata[,1]
countdata
colnames(countdata) <- substr(colnames(countdata), 1, 7)
countdata
## Calculate the Counts Per Million measure
myCPM <- cpm(countdata)
## Identify genes with at least 0.5 cpm in at least 2 samples
thresh <- myCPM > 0.5
keep <- rowSums(thresh) >= 2
# Subset the rows of countdata to keep the more highly expressed genes
counts.keep <- countdata[keep,]
## Convert to an edgeR object
dgeObj <- DGEList(counts.keep)
## Perform TMM normalisation
dgeObj <- calcNormFactors(dgeObj)
## Obtain corrected sample information
sampleinfo <- read.delim("data/SampleInfo_Corrected.txt")
group <- paste(sampleinfo$CellType,sampleinfo$Status,sep=".")
group

Create the design matrix

First we need to create a design matrix for the groups, as we have seen in the linear models lecture. We have two variables, status and cell type. We will fit two models under two assumptions; no interaction and interaction of these two factors.

Let’s start with the model with only main effects, that is no interaction. The main assumption here is that the effect of the status is the same in both type of cells.

design
   (Intercept) typeluminal statuspregnant statusvirgin
1            1           0              0            1
2            1           0              0            1
3            1           0              1            0
4            1           0              1            0
5            1           0              0            0
6            1           0              0            0
7            1           1              0            1
8            1           1              0            1
9            1           1              1            0
10           1           1              1            0
11           1           1              0            0
12           1           1              0            0
attr(,"assign")
[1] 0 1 2 2
attr(,"contrasts")
attr(,"contrasts")$type
[1] "contr.treatment"

attr(,"contrasts")$status
[1] "contr.treatment"

Data exploration

An MDS plot shows distances, in terms of biological coefficient of variation (BCV), between samples. What do you think of the quality of the data? Can you anticipate if the interaction term will be important?

Estimating the dispersion

The common dispersion estimates the overall BCV of the dataset, averaged over all genes:

dgeObj <- estimateCommonDisp(dgeObj)

Then we estimate gene-wise dispersion estimates, allowing a possible trend with averge count size:

dgeObj <- estimateGLMTrendedDisp(dgeObj)
dgeObj <- estimateTagwiseDisp(dgeObj)

Plot the estimated dispersions:

rr plotBCV(dgeObj)

Testing for differential expression

First, we fit genewise glms:

# Fit the linear model
fit <- glmFit(dgeObj, design)
names(fit)
 [1] "coefficients"          "fitted.values"         "deviance"             
 [4] "iter"                  "failed"                "method"               
 [7] "counts"                "unshrunk.coefficients" "df.residual"          
[10] "design"                "offset"                "dispersion"           
[13] "prior.count"           "samples"               "prior.df"             
[16] "AveLogCPM"            
head(coef(fit))
       (Intercept) typeluminal statuspregnant statusvirgin
497097  -11.187922 -7.58804851     -0.7085514  -0.09305118
20671   -12.715063 -1.85287334      0.2269001   0.49554506
27395   -11.221391  0.56368066     -0.1415910  -0.29221577
18777   -10.146793  0.08280255     -0.1845489  -0.48795441
21399    -9.909825 -0.24195503      0.1753606   0.13494615
58175   -16.310131  3.09936215      1.1975518   0.84742701

Conduct likelihood ratio tests for luminal vs basal and show the top genes:

rr lrt.BvsL <- glmLRT(fit, coef=2) topTags(lrt.BvsL)

Coefficient:  typeluminal 
           logFC    logCPM       LR       PValue          FDR
110308 -8.940578 10.264297 24.89789 6.044844e-07 0.0004377961
50916  -8.636503  5.749781 24.80037 6.358512e-07 0.0004377961
12293  -8.362247  6.794788 24.68526 6.749827e-07 0.0004377961
56069  -8.419433  6.124377 24.41532 7.764861e-07 0.0004377961
24117  -9.290691  6.757163 24.32506 8.137331e-07 0.0004377961
12818  -8.216790  8.172247 24.24233 8.494462e-07 0.0004377961
22061  -8.034712  7.255370 24.16987 8.820135e-07 0.0004377961
12797  -9.001419  9.910795 24.12854 9.011487e-07 0.0004377961
50706  -7.697022 10.809629 24.06926 9.293193e-07 0.0004377961
237979 -8.167451  5.215921 24.03528 9.458678e-07 0.0004377961

Challenge

Conduct likelihood ratio tests for virgin vs lactate and show the top genes.

Contrasts

Suppose we want to find differentially expressed genes between pregnant and virgin. We don’t have a parameter that explicitly will allow us to test that hypothesis. We need to build a contrast:

rr PvsV <- makeContrasts(statuspregnant-statusvirgin, levels=design)

Renaming (Intercept) to Intercept

rr lrt.pVsV <- glmLRT(fit, contrast=PvsV) topTags(lrt.pVsV)

Coefficient:  1*statuspregnant -1*statusvirgin 
           logFC    logCPM       LR       PValue FDR
232016 -4.593938  6.389781 12.40835 0.0004274195   1
236643 -6.608868 -1.481424 12.34832 0.0004413842   1
19283  -4.502691  4.318145 10.72832 0.0010550833   1
12993   7.359664 15.507688 10.65284 0.0010990179   1
15903  -3.746794  5.065876 10.53470 0.0011715416   1
544963 -2.988110  4.975414 10.37943 0.0012742723   1
17755  -2.649741  6.118883 10.36888 0.0012815732   1
16687  -5.696048  4.958824 10.12211 0.0014650148   1
381217  3.213414  4.748535 10.08264 0.0014967284   1
14663   7.581478 14.480767 10.01154 0.0015556252   1

Challenge

1.Fit a model with interaction: What is the rationale to include the interaction (What assumption are you relaxing?) 2. Is the number of replicates good enough to include the interaction? 3. Is the interaction needed in the model?

Solution

save(lrt.BvsL,dgeObj,group,file="Robjects/DE.Rdata")

Lun, Aaron T L, Yunshun Chen, and Gordon K Smyth. 2016. “It’s DE-licious: A Recipe for Differential Expression Analyses of RNA-seq Experiments Using Quasi-Likelihood Methods in edgeR.” Methods in Molecular Biology (Clifton, N.J.) 1418 (January): 391–416. doi:10.1007/978-1-4939-3578-9\_19.

LS0tCnRpdGxlOiAiUk5BLXNlcSBhbmFseXNpcyBpbiBSIgpzdWJ0aXRsZTogIkRpZmZlcmVudGlhbCBFeHByZXNzaW9uIG9mIFJOQS1zZXEgZGF0YSIKYXV0aG9yOiAiU3RlcGhhbmUgQmFsbGVyZWF1LCBNYXJrIER1bm5pbmcsIE9zY2FyIFJ1ZWRhLCBBc2hsZXkgU2F3bGUiCmRhdGU6ICdgciBmb3JtYXQoU3lzLnRpbWUoKSwgIkxhc3QgbW9kaWZpZWQ6ICVkICViICVZIilgJwpvdXRwdXQ6CiAgaHRtbF9ub3RlYm9vazoKICAgIHRvYzogeWVzCiAgICB0b2NfZmxvYXQ6IHllcwogIGh0bWxfZG9jdW1lbnQ6CiAgICB0b2M6IHllcwogICAgdG9jX2Zsb2F0OiB5ZXMKbWludXRlczogMzAwCmxheW91dDogcGFnZQpiaWJsaW9ncmFwaHk6IHJlZi5iaWIKLS0tCgpgYGB7ciBzZXR1cCwgaW5jbHVkZT1GQUxTRX0Ka25pdHI6Om9wdHNfY2h1bmskc2V0KGVjaG8gPSBUUlVFKQpgYGAKCioqT3JpZ2luYWwgQXV0aG9yczogQmVsaW5kYSBQaGlwc29uLCBBbm5hIFRyaWdvcywgTWF0dCBSaXRjaGllLCBNYXJpYSBEb3lsZSwgSGFycmlldCBEYXNobm93LCBDaGFyaXR5IExhdyoqCkJhc2VkIG9uIHRoZSBjb3Vyc2UgW1JOQXNlcSBhbmFseXNpcyBpbiBSXShodHRwOi8vY29tYmluZS1hdXN0cmFsaWEuZ2l0aHViLmlvLzIwMTYtMDUtMTEtUk5Bc2VxLykgZGVsaXZlcmVkIG9uIE1heSAxMS8xMnRoIDIwMTYKCiMjIFJlc291cmNlcyBhbmQgZGF0YSBmaWxlcwoKVGhpcyBtYXRlcmlhbCBoYXMgYmVlbiBjcmVhdGVkIHVzaW5nIHRoZSBmb2xsb3dpbmcgcmVzb3VyY2VzOiAgCmh0dHA6Ly93d3cuc3RhdHNjaS5vcmcvc215dGgvcHVicy9RTGVkZ2VSUHJlcHJpbnQucGRmIFtATHVuMjAxNl0gIApodHRwOi8vbW9uYXNoYmlvaW5mb3JtYXRpY3NwbGF0Zm9ybS5naXRodWIuaW8vUk5Bc2VxLURFLWFuYWx5c2lzLXdpdGgtUi85OS1STkFzZXFfREVfYW5hbHlzaXNfd2l0aF9SLmh0bWwgIAoKRGF0YSBmaWxlcyBkb3dubG9hZGVkIGZyb206ICAKZnRwOi8vZnRwLm5jYmkubmxtLm5paC5nb3YvZ2VvL3Nlcmllcy9HU0U2MG5ubi9HU0U2MDQ1MC9zdXBwbC9HU0U2MDQ1MF9MYWN0YXRpb24tR2VuZXdpc2VDb3VudHMudHh0Lmd6Cmh0dHA6Ly9iaW9pbmYud2VoaS5lZHUuYXUvc29mdHdhcmUvTVNpZ0RCL21vdXNlX2MyX3Y1LnJkYXRhCmh0dHA6Ly9iaW9pbmYud2VoaS5lZHUuYXUvc29mdHdhcmUvTVNpZ0RCL21vdXNlX0hfdjUucmRhdGEKCkRhdGEgZmlsZXM6ICAKc2FtcGxlaW5mby50eHQgIApHU0U2MDQ1MF9MYWN0YXRpb24tR2VuZXdpc2VDb3VudHMudHh0ICAKbW91c2VfYzJfdjUucmRhdGEgIAptb3VzZV9IX3Y1LnJkYXRhCgpEYXRhIGZpbGVzIGF2YWlsYWJsZSBmcm9tOiBbaHR0cHM6Ly9maWdzaGFyZS5jb20vcy8xZDc4OGZkMzg0ZDMzZTkxM2EyYV0oaHR0cHM6Ly9maWdzaGFyZS5jb20vcy8xZDc4OGZkMzg0ZDMzZTkxM2EyYSkKWW91IHNob3VsZCBkb3dubG9hZCB0aGVzZSBmaWxlcyBhbmQgcGxhY2UgdGhlbSBpbiB5b3VyIGAvZGF0YWAgZGlyZWN0b3J5LgoKIyMgRGlmZmVyZW50aWFsIGV4cHJlc3Npb24gd2l0aCBlZGdlUgoKTm93IHRoYXQgd2UgYXJlIGhhcHB5IHRoYXQgd2UgaGF2ZSBub3JtYWxpc2VkIHRoZSBkYXRhIGFuZCB0aGF0IHRoZSBxdWFsaXR5IGxvb2tzIGdvb2QsIHdlIGNhbiBjb250aW51ZSB0byB0ZXN0aW5nIGZvciBkaWZmZXJlbnRpYWxseSBleHByZXNzZWQgZ2VuZXMuIFRoZXJlIGFyZSBhIG51bWJlciBvZiBwYWNrYWdlcyB0byBhbmFseXNlIFJOQS1TZXEgZGF0YS4gTW9zdCBwZW9wbGUgdXNlIERFU0VRMiBvciBlZGdlUi4gV2Ugd2lsbCB1c2UgZWRnZVIgZm9yIHRoZSByZXN0IG9mIHRoaXMgcHJhY3RpY2FsLgoKKipGaXJzdCBtYWtlIHN1cmUgd2UgaGF2ZSBhbGwgdGhlIG9iamVjdHMgYW5kIGxpYnJhcmllcyBsb2FkZWQqCgpgYGB7cn0KbGlicmFyeShlZGdlUikKbGlicmFyeShsaW1tYSkKbGlicmFyeShHbGltbWEpCmxpYnJhcnkoZ3Bsb3RzKQpsaWJyYXJ5KG9yZy5NbS5lZy5kYikKbG9hZCgiUm9iamVjdHMvcHJlcHJvY2Vzc2luZy5SZGF0YSIpCmBgYAoKCiMjIyBSZWNhcCBvZiBwcmUtcHJvY2Vzc2luZwoKVGhlIHByZXZpb3VzIHNlY3Rpb24gd2Fsa2VkLXRocm91Z2ggdGhlIHByZS1wcm9jZXNzaW5nIGFuZCB0cmFuc2Zvcm1hdGlvbiBvZiB0aGUgY291bnQgZGF0YS4gSGVyZSwgZm9yIGNvbXBsZXRlbmVzcywgd2UgbGlzdCB0aGUgbWluaW1hbCBzdGVwcyByZXF1aXJlZCB0byBwcm9jZXNzIHRoZSBkYXRhIHByaW9yIHRvIGRpZmZlcmVudGlhbCBleHByZXNzaW9uIGFuYWx5c2lzLgoKYGBge3IgZXZhbD1GQUxTRX0KIyMgUmVhZCB0aGUgY291bnRzIGZyb20gdGhlIGRvd25sb2FkZWQgZGF0YQpzZXFkYXRhIDwtIHJlYWQuZGVsaW0oImRhdGEvR1NFNjA0NTBfTGFjdGF0aW9uLUdlbmV3aXNlQ291bnRzLnR4dCIsIHN0cmluZ3NBc0ZhY3RvcnMgPSBGQUxTRSkKIwojIFJlbW92ZSBmaXJzdCB0d28gY29sdW1ucyBmcm9tIHNlcWRhdGEKCmNvdW50ZGF0YSA8LSBzZXFkYXRhWywtKDE6MildCgojIFN0b3JlIEVudHJlekdlbmVJRCBhcyByb3duYW1lcwpyb3duYW1lcyhjb3VudGRhdGEpIDwtIHNlcWRhdGFbLDFdCmNvdW50ZGF0YQpjb2xuYW1lcyhjb3VudGRhdGEpIDwtIHN1YnN0cihjb2xuYW1lcyhjb3VudGRhdGEpLCAxLCA3KQpjb3VudGRhdGEKIyMgQ2FsY3VsYXRlIHRoZSBDb3VudHMgUGVyIE1pbGxpb24gbWVhc3VyZQpteUNQTSA8LSBjcG0oY291bnRkYXRhKQojIyBJZGVudGlmeSBnZW5lcyB3aXRoIGF0IGxlYXN0IDAuNSBjcG0gaW4gYXQgbGVhc3QgMiBzYW1wbGVzCnRocmVzaCA8LSBteUNQTSA+IDAuNQprZWVwIDwtIHJvd1N1bXModGhyZXNoKSA+PSAyCiMgU3Vic2V0IHRoZSByb3dzIG9mIGNvdW50ZGF0YSB0byBrZWVwIHRoZSBtb3JlIGhpZ2hseSBleHByZXNzZWQgZ2VuZXMKY291bnRzLmtlZXAgPC0gY291bnRkYXRhW2tlZXAsXQojIyBDb252ZXJ0IHRvIGFuIGVkZ2VSIG9iamVjdApkZ2VPYmogPC0gREdFTGlzdChjb3VudHMua2VlcCkKIyMgUGVyZm9ybSBUTU0gbm9ybWFsaXNhdGlvbgpkZ2VPYmogPC0gY2FsY05vcm1GYWN0b3JzKGRnZU9iaikKIyMgT2J0YWluIGNvcnJlY3RlZCBzYW1wbGUgaW5mb3JtYXRpb24Kc2FtcGxlaW5mbyA8LSByZWFkLmRlbGltKCJkYXRhL1NhbXBsZUluZm9fQ29ycmVjdGVkLnR4dCIpCmdyb3VwIDwtIHBhc3RlKHNhbXBsZWluZm8kQ2VsbFR5cGUsc2FtcGxlaW5mbyRTdGF0dXMsc2VwPSIuIikKZ3JvdXAKYGBgCgoKIyMjIENyZWF0ZSB0aGUgZGVzaWduIG1hdHJpeAoKRmlyc3Qgd2UgbmVlZCB0byBjcmVhdGUgYSBkZXNpZ24gbWF0cml4IGZvciB0aGUgZ3JvdXBzLCBhcyB3ZSBoYXZlIHNlZW4gaW4gdGhlIGxpbmVhciBtb2RlbHMgbGVjdHVyZS4gCldlIGhhdmUgdHdvIHZhcmlhYmxlcywgc3RhdHVzIGFuZCBjZWxsIHR5cGUuIFdlIHdpbGwgZml0IHR3byBtb2RlbHMgdW5kZXIgdHdvIGFzc3VtcHRpb25zOyBubyBpbnRlcmFjdGlvbiBhbmQgaW50ZXJhY3Rpb24gb2YgdGhlc2UgdHdvIGZhY3RvcnMuIAoKTGV0J3Mgc3RhcnQgd2l0aCB0aGUgbW9kZWwgd2l0aCBvbmx5IG1haW4gZWZmZWN0cywgdGhhdCBpcyBubyBpbnRlcmFjdGlvbi4gVGhlIG1haW4gYXNzdW1wdGlvbiBoZXJlIGlzIHRoYXQgdGhlIGVmZmVjdCBvZiB0aGUgc3RhdHVzIGlzIHRoZSBzYW1lIGluIGJvdGggdHlwZSBvZiBjZWxscy4KCmBgYHtyfQojIENyZWF0ZSB0aGUgdHdvIHZhcmlhYmxlcwpncm91cCA8LSBhcy5jaGFyYWN0ZXIoZ3JvdXApCnR5cGUgPC0gc2FwcGx5KHN0cnNwbGl0KGdyb3VwLCAiLiIsIGZpeGVkPVQpLCBmdW5jdGlvbih4KSB4WzFdKQpzdGF0dXMgPC0gc2FwcGx5KHN0cnNwbGl0KGdyb3VwLCAiLiIsIGZpeGVkPVQpLCBmdW5jdGlvbih4KSB4WzJdKQojIFNwZWNpZnkgYSBkZXNpZ24gbWF0cml4IHdpdGggYW4gaW50ZXJjZXB0IHRlcm0KZGVzaWduIDwtIG1vZGVsLm1hdHJpeCh+IHR5cGUgKyBzdGF0dXMpCmRlc2lnbgpgYGAKCgoKIyMjIERhdGEgZXhwbG9yYXRpb24KQW4gTURTIHBsb3Qgc2hvd3MgZGlzdGFuY2VzLCBpbiB0ZXJtcyBvZiBiaW9sb2dpY2FsIGNvZWZmaWNpZW50IG9mIHZhcmlhdGlvbiAoQkNWKSwgYmV0d2VlbiBzYW1wbGVzLiBXaGF0IGRvIHlvdSB0aGluayBvZiB0aGUgcXVhbGl0eSBvZiB0aGUgZGF0YT8gQ2FuIHlvdSBhbnRpY2lwYXRlIGlmIHRoZSBpbnRlcmFjdGlvbiB0ZXJtIHdpbGwgYmUgaW1wb3J0YW50PwpgYGB7cn0KcGxvdE1EUyhkZ2VPYmosIGxhYmVscz1ncm91cCwgY2V4PTAuNzUsIHhsaW09YygtNCwgNSkpCmBgYAojIyMgRXN0aW1hdGluZyB0aGUgZGlzcGVyc2lvbgoKVGhlIGNvbW1vbiBkaXNwZXJzaW9uIGVzdGltYXRlcyB0aGUgb3ZlcmFsbCBCQ1Ygb2YgdGhlIGRhdGFzZXQsIGF2ZXJhZ2VkIG92ZXIgYWxsIGdlbmVzOgpgYGB7cn0KZGdlT2JqIDwtIGVzdGltYXRlQ29tbW9uRGlzcChkZ2VPYmopCmBgYAoKVGhlbiB3ZSBlc3RpbWF0ZSBnZW5lLXdpc2UgZGlzcGVyc2lvbiBlc3RpbWF0ZXMsIGFsbG93aW5nIGEgcG9zc2libGUgdHJlbmQgd2l0aCBhdmVyZ2UgY291bnQgc2l6ZToKYGBge3J9CmRnZU9iaiA8LSBlc3RpbWF0ZUdMTVRyZW5kZWREaXNwKGRnZU9iaikKZGdlT2JqIDwtIGVzdGltYXRlVGFnd2lzZURpc3AoZGdlT2JqKQpgYGAKUGxvdCB0aGUgZXN0aW1hdGVkIGRpc3BlcnNpb25zOgpgYGB7cn0KcGxvdEJDVihkZ2VPYmopCmBgYAoKCiMjIyBUZXN0aW5nIGZvciBkaWZmZXJlbnRpYWwgZXhwcmVzc2lvbgoKRmlyc3QsIHdlIGZpdCBnZW5ld2lzZSBnbG1zOgoKYGBge3J9CiMgRml0IHRoZSBsaW5lYXIgbW9kZWwKZml0IDwtIGdsbUZpdChkZ2VPYmosIGRlc2lnbikKbmFtZXMoZml0KQpoZWFkKGNvZWYoZml0KSkKYGBgCkNvbmR1Y3QgbGlrZWxpaG9vZCByYXRpbyB0ZXN0cyBmb3IgbHVtaW5hbCB2cyBiYXNhbCBhbmQgc2hvdyB0aGUgdG9wIGdlbmVzOgpgYGB7cn0KbHJ0LkJ2c0wgPC0gZ2xtTFJUKGZpdCwgY29lZj0yKQp0b3BUYWdzKGxydC5CdnNMKQoKYGBgCgoKPiAjIyBDaGFsbGVuZ2Ugey5jaGFsbGVuZ2V9Cj4gQ29uZHVjdCBsaWtlbGlob29kIHJhdGlvIHRlc3RzIGZvciB2aXJnaW4gdnMgbGFjdGF0ZSBhbmQgc2hvdyB0aGUgdG9wIGdlbmVzLgoKYGBge3J9CgpgYGAKCgoKIyMjIENvbnRyYXN0cwoKU3VwcG9zZSB3ZSB3YW50IHRvIGZpbmQgZGlmZmVyZW50aWFsbHkgZXhwcmVzc2VkIGdlbmVzIGJldHdlZW4gcHJlZ25hbnQgYW5kIHZpcmdpbi4gV2UgZG9uJ3QgaGF2ZSBhIHBhcmFtZXRlciB0aGF0IGV4cGxpY2l0bHkgd2lsbCBhbGxvdyB1cyB0byB0ZXN0IHRoYXQgaHlwb3RoZXNpcy4gV2UgbmVlZCB0byBidWlsZCBhIGNvbnRyYXN0OgoKYGBge3J9ClB2c1YgPC0gbWFrZUNvbnRyYXN0cyhzdGF0dXNwcmVnbmFudC1zdGF0dXN2aXJnaW4sIGxldmVscz1kZXNpZ24pCmxydC5wVnNWIDwtIGdsbUxSVChmaXQsIGNvbnRyYXN0PVB2c1YpCnRvcFRhZ3MobHJ0LnBWc1YpCmBgYAoKCj4gIyMgQ2hhbGxlbmdlIHsuY2hhbGxlbmdlfQo+Cj4gMS5GaXQgYSBtb2RlbCB3aXRoIGludGVyYWN0aW9uOiBXaGF0IGlzIHRoZSByYXRpb25hbGUgdG8gaW5jbHVkZSB0aGUgaW50ZXJhY3Rpb24gKFdoYXQgYXNzdW1wdGlvbiBhcmUgeW91IHJlbGF4aW5nPykKPiAyLiBJcyB0aGUgbnVtYmVyIG9mIHJlcGxpY2F0ZXMgZ29vZCBlbm91Z2ggdG8gaW5jbHVkZSB0aGUgaW50ZXJhY3Rpb24/Cj4gMy4gSXMgdGhlIGludGVyYWN0aW9uIG5lZWRlZCBpbiB0aGUgbW9kZWw/CgoqKlNvbHV0aW9uKioKYGBge3IsZWNobz1GQUxTRX0KIyBTb2x1dGlvbgoKYGBgCgpgYGB7cn0Kc2F2ZShscnQuQnZzTCxkZ2VPYmosZ3JvdXAsZmlsZT0iUm9iamVjdHMvREUuUmRhdGEiKQpgYGAKCg==