---
title: "Introduction to dnapath"
author: "Tyler Grimes"
date: "`r Sys.Date()`"
output:
  html_vignette:
    number_sections: yes
    self_contained: yes
    toc: true
vignette: >
  %\VignetteIndexEntry{Introduction to dnapath}
  %\VignetteEngine{knitr::rmarkdown}
  \usepackage[utf8]{inputenc}
---

```{r setup, message=FALSE, echo=FALSE}
reset_options_scipen <- getOption("scipen")
reset_options_digits <- getOption("digits")
options(scipen = 1, digits = 5)
library(dnapath)
set.seed(12345)
```

This is a brief introduction to the `dnapath` package. This package integrates known pathway information into the differential network analysis of gene expression data. It allows for any network inference method to be used, and provides wrapper functions for several popular methods; these all start with `run_` for ease of searching. Various helper function such as `summary()` and `plot()` are implemented for summarizing and visualizing the differential network results. This package is a companion to the paper:

> Grimes, T., Potter, S. S., & Datta, S. (2019). Integrating gene regulatory pathways into differential network analysis of gene expression data. *Scientific reports*, 9(1), 1-12.


**************
# Installation

You can install `dnapath` from CRAN:

```R
install.packages("dnapath")
```

# Data

The package contains two datasets, `meso` and `cancer_pathways`. The "Package data" vignette shows how these two datasets were created, and it illustrates the use of various methods in the `dnapath` package.

* The `meso` data contains gene expression data for two groups (stage ii and stage iv) of Mesothelioma tumors.

* The `cancer_pathways` data is a list of cancer-related (P53) gene pathways from the Reactome database.

These are the two primary inputs to the `dnapath()` method -- a gene expression dataset and a list of pathways -- and are used to demonstrate the package usage in this vignette.

> **Note:** the `dnapath` package is not limited to cancer data. The analysis demonstrated in this introduction can be applied to any gene expression datasets from any species. 

# Overview of Functions

The main function of the package is `dnapath()`, which performs the differential network analysis on a gene expression dataset over a user-specified list of pathways. The output of this function is a `dnapath_list` object (or `dnapath` object if only one pathway is considered). An overview of its **arguments** is shown here:

* `dnapath()`: The main function for running the differential network analysis.
  - **x**	- The gene expression data to be analyzed. Either (1) a list of two matrices or data frames that contain the gene expression profile from two populations (groups), or (2) a single matrix or data frame that contains the expression profiles for both groups. Rows should correspond to samples and columns to individual genes. 
  - **pathway_list** - A single vector or list of vectors containing gene names to indicate pathway membership. The vectors are used to subset the columns of the matrices in 'x'.
  - **groups**	- If `x` is a single matrix, `groups` must be specified to label each row. `groups` is a vector of length equal to the number of rows in `x`, and it should contain two unique elements (the two group names).
  - **network_inference** - A function used to infer the pathway network. It should take in an n by p matrix and return a p by p matrix of association scores. Built-in options are available, all being with `run_`. The default is `run_pcor` which computes partial correlations.
  - **n_perm** - The number of random permutations to perform during permutation testing. If `n_perm == 1`, the permutation tests are not performed. If `n_perm` is larger than the number of possible permutations, `n_perm` will be set to this value with a warning message.
  - **lp** - The lp value used to compute differential connectivity scores.
  - **seed** - (Optional) Used to `set.seed` prior to permutation test for each pathway. This allows results for individual pathways to be easily reproduced.
  
An overview of the other methods available in the `dnapath` package is given in the following sections.

## Summarizing and visualizing the results

The `dnapath_list` and `dnapath` objects obtained from running `dnapath()` can be summarized and visualized using various methdos.
  
* `filter_pathways()`: Removes any pathways from the results that were not significantly differentially connected (based on the permutation test p-values for the pathway-level connectivity). 

* `subset()` : Subset the results based on pathways or genes of interest.
  - **x** - A `dnapath_list` object.
  - **pathways** - A set of pathways to subset on. This can be (1) a vector of character strings, corresponding to pathway names or regular expressions used to find pathways, (2) a vector of indices to select pathways, (3) a vector of negative indices indicating pathways to remove, or (4) a logical (boolean) vector that is the same length of current number of pathways in x.
  - **genes** - A set of gene names to index on; exact matching is used. Only pathways containing these genes are retained.

* `sort()` : Sorts the pathways in the results.  
  - **x** - A `dnapath_list` object.
  - **decreasing** - If TRUE (the default), results are sorted in decreasing order.
  - **by** - Used to specify which feature to sort by. These include: 
  `by =  "mean_expr"`, the mean expression of each pathway across both groups; 
  `by = "mean_expr1"` or `by = "mean_expr2"`, the mean expression of each pathway in group 1 or 2, respectively; 
  `by = "dc_score"`, the differential connectivity score of the pathway; 
  `by = "p_value"`, the p-value of the dc score; 
  `by = "n_genes"`, the number of genes in each pathway; or
  `by = "n_dc"` the number of significantly differentially conncted genes in each pathway.

* `summary()` : Creates a summary table for a `dnapath_list` or `dnapath` object.

* `plot()` : Plot the differential network from a `dnapath` object.

* `plot_pair()` : Plot the expression values of two genes to visualize their marginal association.


## Obtaining a list of Reactome pathways

The user may specify any list of gene sets to use in the analysis. However, for convenience `dnapath` provides a function for obtaining a list of Reactome pathways for a given species. This list may be useful for most analyses.

* `get_reactome_pathways()` : Connects to the Reactome database (using the `reactome.db` package) to obtain a list of pathways for a given species.
  - **species** - The species to obtain a pathway list for. For example, "Homo sapiens" or "Mus musculus". 
  - **overlap_limit** - A value betwen 0 and 1. This is used to combine pathways that have substantial overlap. The default value is 0.9, so any two pathways that contain 90\% or more genes will be combined into a single pathway. 
  - **min_size** - The minimum pathway size. Any Reactome pathways with fewer than `min_size` genes are omitted from the list.
  - **max_size** - The maximum pathway size. Any Reactome pathways with more than `max_size` genes are removed from the list.
  
## Renaming entrezgene IDs to gene symbols

The Reactome pathways are based on entrezgene IDs, which are a unique identifier for individual genes. It is recommended to also
annotate RNA-seq data using entrezgene IDs when obtaining gene expression counts. However, when summarizing and visualizing the differential network analysis results, it may be preferred to use gene symbols. The functions in this section are used to rename the genes in a `dnapath_list` or `dnapath` object, or a pathway list.

* `rename_genes()`: Used to rename the genes contained in the differential network analysis results. This is useful if the user wants to, for example, create tables or plots summarizing the data using gene symbols rather than Entrezgene IDs. Note: this function can also be used to rename the genes in a pathway list.
  - **x** - A `dnapath_list` or `dnapath` object, or a pathway list.
  - **gene_mat** - A two column matrix or data frame. The first column should contain the current gene names, and the second column the new gene names. Any gene that are not in this matrix (that is, genes in the dnapath results but not in the left column of this matrix) will retain their current name.
  - **to** - (Optional) Setting `to = "symbol"` will rename entrezgene IDs to gene symbols; this will automatically call the `entrez_to_symbol` method (defined below) to obtain the **gene_mat** matrix. The **species** arugment must also be specified when to is used.
  - **species** - (Optional) Must be specified when setting to = "symbol". This argument is passed into `entrez_to_symbol()`.

* `entrez_to_symbol()` : Maps entrezgene IDs to gene symbols using the `biomaRt` package. The Reactome pathways use entrezgene IDs, and many RNA-seq pipelines will use entrezgene IDs for annotation. However, gene symbols are more recognizable and may be preferred for summarizing and visualizing results. This method maps entrezgene IDs to gene symbols, and the resulting two column matrix can be used with the `rename_genes()` method to rename entrezgene IDs as gene symbols.

* `symbol_to_entrez()` : Maps gene symbols to entrezgene IDs using the `biomaRt` package. This can be useful for renaming gene expression datasets that contain gene symbols. Note, however, that gene symbols can be ambiguous and may map to multiple entrezgene IDs. It is recommended to use entrezgene IDs throughout the analysis and only rename with gene symbols when summarizing the results.

* `get_genes()` : This method extracts the genes in a `dnapath_list` or `dnapath` object, or from a pathway list. This is not meant to summarize the results of the differential network analysis, but rather to help when renaming the genes in the results; the output is a vector of gene names that can be used in `entrez_to_symbol` or `symbol_to_entrez`.

## Network inference methods

There are also serveral network inference methods provided in this package. Many of these are available in other R packages, but the format of their inputs and outputs can vary. Wrapper functions have been created to standardize these aspects. The method names are all prefixed with `run_` (for easy searching) and can be used as the **network_inference** arugment in `dnapath()`. The methods are listed here, and additional information/references can be found in the package documentation.

* `run_aracne`, `run_bc3net`, `run_c3net`, `run_corr`, `run_dwlasso`, `run_genie3`, `run_glasso`, `run_mrnet`, `run_pcor`, and `run_silencer`.
  - All methods take in an $n$ by $p$ matrix of gene expression counts ($n$ samples and $p$ genes) as its first argument. The output of each is a $p$ by $p$ matrix of association scores.

The default method used is `run_pcor`, which infers the gene-gene association network using partial correlations. It is important to note that different measures may be better suited for answering different research questions, however those details are beyond the scope of this vignette.

> **Note:** For more information on any method, use the `help()` or `?` command in R to open the documentation (for example `help(run_aracne)` or `?run_pcor`). 

# Real data analysis example

This example will analyze the `meso` data provided in the package. (The "Package data" vignette shows how these data were obtained.) First we load the data and take a look at it.

```{r}
data(meso)
str(meso)
```

The data is a list containing (1) a gene expression data set of 32 samples and 150 genes and (2) a vector indicating which group each sample belongs to -- stageii (group 1) or stage iv (group 2).

## No pathway information

The differential network analysis compares the gene-gene association network between the two groups (stage ii vs stage iv). The `dnapath` package *enables* the use of known pathway information into the analysis, but a pathway list is not required. The `dnapath()` method can be run on the full gene expression dataset, without using pathways:

```{r warning=FALSE}
# Run dnapath using the gene expression and group information from meso dataset.
results <- dnapath(meso$gene_expression, 
                   pathway_list = NULL, 
                   groups = meso$groups)
results
```

Printing the results provides a summary of the differential network analysis. The output shows that "stageii" and "stageiv" groups were compared. It says a single "unnamed pathway" was analyzed containing 150 genes; this is referring to the fact that all genes in the dataset were analyzed together and no pathway list was provided. The mean expression level of all genes in each group are also shown (these are 9.3 and 9.4, respectively, for this data), and a p-value (0.723) of the overall differential connectivity. 

The output shows the differential network analysis results at the gene level. This table can be obtained using `summary(results)`, which returns a `tibble` that can be filtered and sorted using base `R` functions or methods from the `dplyr` package. The columns in this table include: **genes**, the genes analyzed in this pathway; **dc_score**, the differentially connectivity (DC) score estimated for this gene; **p_value**, the permutation p-value for the DC score (under the null hypothesis of no differential connectivity); **p_value_m**, monotonized p-values, which are a conservative estimate; **mean_expr1**, the mean expression of each gene in group 1; **mean_expr2**, the mean expression of each gene in group 2.

The `plot` function can be used to view the differential network. In this case, since all genes were analyzed together, the differential network will show all genes present in the gene expression dataset.

> The `alpha = 0.05` argument will remove any edges whose differential connectivity score p-value is above 0.05.

```{r}
plot(results, alpha = 0.05)
```

With 150 genes, the visualization of the differential network is not very useful; it is difficult to extract much information from this plot. One of the benefits of using known pathway information is that it breaks down the analysis into smaller gene sets, and the resulting differential networks are more manageable and informative. These advantages are illustrated in the next section.

## Using a pathway list

The main feature of `dnapath` is that it incorporates known gene pathways into the differential network analysis. A pathway is nothing more than a set of genes that is thought to belong to a particular biological process. The `get_reactome_pathways` method can be used to obtain a list of pathways from the Reactome database. 

In this section, we will use the `p53_pathways` data that accompanies the package. TP53 is a oncogene that is often mutated in many cancers, and the `p53_pathways` list contains 13 pathways related to P53 signaling. 

> We refer the reader to the "Package data" vignette for details on how the `p53_pathways` list was created. That vignette illustrates how to use `get_reactome_pathways()`. 

The only difference compared to the previous section is that the `pathway_list` argument is now specified when running `dnapath()`. 

```{r}
data(meso) # Load the gene expression data
data(p53_pathways)

# Run the differntial network analysis.
results <- dnapath(x = meso$gene_expression,
                   pathway_list = p53_pathways,
                   groups = meso$groups)

results
```

The results can be filtered using the `filter_pathways` method remove any pathways with differential connectivity p-values above some threshold.

```{r}
results <- filter_pathways(results, alpha_pathway = 0.2)
results
```

Pathways can be plotted one at a time by indexing the results list. The following code shows how to print out the first pathway. 

> **Note:** The layout of the nodes is random when generating plots. For reproducible plots, the random number generator seed needs to be set prior to plotting. 

```{r}
# The plot layout is stochastic. Setting the RNG seed allows for reproducible plots.
set.seed(123)
plot(results[[1]])
```

This plot uses entrezgene IDs, which are the identifiers used in the gene expression and pathway list data. At this point in the analysis it can be convenient to translate these IDs to the more recognizable gene symbols. The `rename_genes` method can be used to achieve this.

> **Note:** Internet connection is required to connect to biomaRt, which `rename_genes` uses to map entrezgene IDs to gene symbols. The `dir_save` argument can be set when running `rename_genes()` which will save the ID mapping obtained from biomaRt in the specified directory. This way, the mapping can be obtained once (using the internet connection) and accessed from memory in all future calls of `rename_genes()`. A temporary directory is used in this example.


```{r}
results <- rename_genes(results, to = "symbol", species = "human",
                        dir_save = tempdir())
results[[1]]
```

```{r}
set.seed(123) # Reset seed to use same layout as previous plot.
plot(results[[1]])
```

The differential network plot shows a lot of information about the two groups being compared. First, the nodes are scaled based on the gene's average expression across both groups. If the gene is differentially expressed, then the node will be shaded blue or red, depending on if the gene has higher expression in group 1 or group 2, respectively. For example, in the plot above we see that the node for IGFBP3 is slightly red, indicating a higher expression in group 2. However, because the shade is very light, the fold change is not high. This can be verified in the table above -- the fourth row shows that IGFBP3 has mean expression of 11.1 in group 1 and 11.9 in group 2, which is only a modest change.

The edges in the network are similarly colored. Blue edges indicate that the gene-gene association is stronger in group 1, whereas red edges are stronger in group 2. The thickness of the edges are scaled according to the magnitude of the association, and the opacity is scaled based on the p-value of the edge's differential connectivity score. That is, a thick, opaque edge is a strong association with high statistical evidence of differential connectivity (low p-value), but a thin, transparent edge is a relatively weaker association with less evidence of differential connectivity (high p-value). For example, the red edge between FAS and TP73 is dark red -- indicating that the association is stronger in group 2 -- and its width is wide suggesting that the association is strong (in at least one of the two groups) compared to other connections. In contrast, the edge between TP53 and TNFRSF10A is light blue -- indicating weaker statistical evidence of a stronger association in group 1 -- and is relatively thin indicating that the two genes have a more modest association in at least one of the two groups. This all can be verified from a summary table of the differntial network's edges (see rows 1 and 9):

```{r}
# Summary table of the edges in pathway 1.
# Note: could instead use the summarize_edges(results[[1]]) function call.
summary(results[[1]], by_gene = FALSE) # Set by_gene to FALSE to obtain edges.
```

The table summarizes each edge in the differential network, sorted by p-values. The top edges in the table are also the most noticeable edges in the plot above. Edges edges with high p-values can be filtered out using the `alpha` argument.

```{r}
summary(results[[1]], by_gene = FALSE, alpha = 0.05)
```

Each edge in the differential network corresponds to a pair of genes. The association between any pair of genes can be visualized using `plot_pair()`. We demonstrate this function by visualizing FAS amd TP73.

```{r}
plot_pair(results, "FAS", "TP73")
```

From this plot, it appears that the marginal association between FAS and TP73 are quite similar between the two groups. However, recall that the association measure used in the differential network analysis is the partial correlation, which is a conditional association measure that takes into account the other genes in the pathway. It is important to remember that the marginal plot created by `plot_pair()` does not show all the information that the differential network analysis uses, however it may be a useful visualization to check the results obtained from the analysis.




## Using other network inference methods

The default network inference method is `run_pcor`, which uses partial correlations to estimate the gene association network in the two groups. This is changed by setting the `network_inference` argument in `dnapath()`. For example:

```R
# Run the differntial network analysis using ARACNE.
results <- dnapath(x = meso$gene_expression,
                   pathway_list = p53_pathways,
                   groups = meso$groups,
                   network_inference = run_aracne)
```

All of the summary and plotting functions behave the same as before regardless of the network inference method used. Note however, if the chosen method produces a dense network (such as `run_corr`), then the visualization may become more cluttered. In addition, some methods are more computationally intensive (such as `run_genie3`), and the differential network analysis will become more time consuming. To help counter this, the number of permutations performed for the significance testing can be lowered (the default is `n_perm = 100`). For example:

```R
# Run the differntial network analysis using GENIE3 with 20 permutations.
results <- dnapath(x = meso$gene_expression,
                   pathway_list = p53_pathways,
                   groups = meso$groups,
                   network_inference = run_genie3,
                   n_perm = 20)
```

Alternatively, there may be tuning parameters in the network inference method that can speed up computation. For example, in `run_genie3`, the `nTrees` argument might be lowered to tradeoff performance for computation time. This parameter can be adjusted using the additional `...` argument of `dnapath`.

```R
# Run the differntial network analysis using GENIE3 with 20 permutations.
results <- dnapath(x = meso$gene_expression,
                   pathway_list = p53_pathways,
                   groups = meso$groups,
                   network_inference = run_genie3,
                   nTrees = 10)
```

# Summary

In this brief introduction to the `dnapath` package, we have reviewed the basic steps for conducting the differential network analysis and for summarizing the results with tables and plots. The examples here used the Mesothelioma dataset that accompanies the package, but we note again that the package is not limited to analyzing cancer datasets. 

```{r echo=FALSE}
options(scipen = reset_options_scipen, digits = reset_options_digits)
```