# Getting started with `amt`

#### Johannes Signer

#### 2020-03-30

## Basics

### Creating a track

The basic building blocks of `amt` are tracks. Tracks are `tibble`s with at least two columns that contain the coordinates: `x_` and `y_`. A track behaves exactly like a `tibble` (the only difference being that we added an other S3 class). Below is an example of creating a track with some dummy locations.

    library(dplyr)
    library(ggplot2)
    library(amt)
    df1 <- tibble(x = 1:3, y = 1:3)
    is.data.frame(df1)

    ## [1] TRUE

    df1

    ## # A tibble: 3 x 2
    ##       x     y
    ##   <int> <int>
    ## 1     1     1
    ## 2     2     2
    ## 3     3     3

    # Now we can create a track
    tr1 <- make_track(df1, x, y)
    is.data.frame(tr1)

    ## [1] TRUE

    tr1

    ## # A tibble: 3 x 2
    ##      x_    y_
    ## * <int> <int>
    ## 1     1     1
    ## 2     2     2
    ## 3     3     3

At the moment `amt` supports two types of tracks:

- `track_xy` is a track that only has coordinates, and
- `track_xyt` is a track that has a timestamp associated to each coordinate pair.

If a `track_xy` or `track_xyt` is created with the function `make_track`, is determined whether or not a timestamp is passed as a thrid argument (called `.t`) to the function `make_track`. In the previous example we only passed `x` and `y` coordinates. Hence a `track_xy` was created.

    class(tr1)

    ## [1] "track_xy"   "tbl_df"     "tbl"        "data.frame"

To create a `track_xyt` we could do the following

    df1 <- tibble(x = 1:3, y = 1:3, t = lubridate::ymd("2017-01-01") + lubridate::days(0:2))
    tr2 <- make_track(df1, x, y, t)

    ## .t found, creating `track_xyt`.

    class(tr2)

    ## [1] "track_xyt"  "track_xy"   "tbl_df"     "tbl"        "data.frame"

From the output above we see that a `track_xyt` is also a `track_xy`. This means that all methods for `track_xy` also work for a `track_xyt` (but not the reverse).

### Adding additional information

We can also add additional information for each relocation (e.g., the id of the animal, or some other sensor information such as the DOP). Any number of additional named columns can be passed to `make_track`. By named we mean, that columns should always be passed in the form of `column_name = content` to avoid confusion with coordinates and time stamp. We will extend the dummy example from above, by passing 2 more columns (the id of animal and the age).

    df1 <- tibble(x = 1:3, y = 1:3, t = lubridate::ymd("2017-01-01") + lubridate::days(0:2),
                      id = 1, age = 4)

    # first we only create a track_xy
    tr3 <- make_track(df1, x, y, id = id, age = age)

    ## .t missing, creating `track_xy`.

    tr3

    ## # A tibble: 3 x 4
    ##      x_    y_    id   age
    ## * <int> <int> <dbl> <dbl>
    ## 1     1     1     1     4
    ## 2     2     2     1     4
    ## 3     3     3     1     4

    # now lets create a track_xyt
    tr4 <- make_track(df1, x, y, t, id = id, age = age)

    ## .t found, creating `track_xyt`.

    tr4

    ## # A tibble: 3 x 5
    ##      x_    y_ t_            id   age
    ## * <int> <int> <date>     <dbl> <dbl>
    ## 1     1     1 2017-01-01     1     4
    ## 2     2     2 2017-01-02     1     4
    ## 3     3     3 2017-01-03     1     4

### Coordinate refenece system

`make_track` has one further optional argument (`crs`), which allows the user to set a coordinate reference system (CRS) of the track. The CRS needs to be provided as valid `proj4string`, see the documentation of `sp::CRS` for further details.

### An example with one real animal

In the `amt` relocation data of one red deer from northern Germany is included. We will use this data set to to illustrate how to create a track.

We benign with loading and inspecting the data.

    data(sh)
    head(sh)

    ##   x_epsg31467 y_epsg31467        day     time
    ## 1     3558403     5999400 2009-02-13 00:02:23
    ## 2     3558548     5999099 2009-02-13 06:02:21
    ## 3     3558541     5999019 2009-02-13 12:01:51
    ## 4     3558453     5999026 2009-02-13 18:00:55
    ## 5     3558566     5999365 2009-02-14 00:01:36
    ## 6     3557836     5999185 2009-02-14 06:02:24

Before creating a track, we have to do some data cleaning:

1. check if any coordinates are missing (and if so, remove the relocation),
2. parse the date and time,
3. create a time stamp,
4. check for duplicated time stamps, and
5. create two new columns for the id and month of the year.

    # check if all observations are complete
    all(complete.cases(sh)) # no action required

    ## [1] TRUE

    # parse date and time and create time stamps
    sh$ts <- as.POSIXct(lubridate::ymd(sh$day) +
                          lubridate::hms(sh$time))

    # check for duplicated time stamps
    any(duplicated(sh$ts))

    ## [1] TRUE

    # We have some duplicated time stamps, these need to be removed prior to
    # creating a track.
    sh <- sh[!duplicated(sh$ts), ]

    # create new columns
    sh$id <- "Animal 1"
    sh$month <- lubridate::month(sh$ts)

Now we can create a track.

    tr1 <- make_track(sh, x_epsg31467, y_epsg31467, ts, id = id, month = month)

    ## .t found, creating `track_xyt`.

The column names of the data set already indicate the CRS of the data. We can add this information when creating a track.

    tr1 <- make_track(sh, x_epsg31467, y_epsg31467, ts, id = id, month = month,
                    crs = sp::CRS("+init=epsg:31467"))

    ## .t found, creating `track_xyt`.

### A note on pipes (`%>%`)

`amt` was heavily inspired through workflows suggested by the popular packages from the `tidyverse`. The above steps could easily be connected using pipes. Note that result will be exactly the same.

    data(sh)
    tr2 <- sh %>% filter(complete.cases(.)) %>%
      mutate(
        ts = as.POSIXct(lubridate::ymd(day) + lubridate::hms(time)),
        id = "Animal 1",
        month = lubridate::month(ts)
      ) %>%
      filter(!duplicated(ts)) %>%
      make_track(x_epsg31467, y_epsg31467, ts, id = id, month = month,
               crs = sp::CRS("+init=epsg:31467"))

    ## .t found, creating `track_xyt`.

    tr2

    ## # A tibble: 1,493 x 5
    ##         x_      y_ t_                  id       month
    ##  *   <int>   <int> <dttm>              <chr>    <dbl>
    ##  1 3558528 5999094 2008-03-30 00:01:47 Animal 1     3
    ##  2 3558513 5999055 2008-03-30 06:00:54 Animal 1     3
    ##  3 3558564 5999146 2008-03-30 12:01:47 Animal 1     3
    ##  4 3558504 5999072 2008-03-30 18:01:24 Animal 1     3
    ##  5 3558495 5999051 2008-03-30 18:25:56 Animal 1     3
    ##  6 3558493 5999052 2008-03-30 18:26:05 Animal 1     3
    ##  7 3558489 5999051 2008-03-30 18:26:14 Animal 1     3
    ##  8 3558486 5999046 2008-03-30 18:26:24 Animal 1     3
    ##  9 3558484 5999052 2008-03-30 18:26:33 Animal 1     3
    ## 10 3558317 5998989 2008-03-30 18:38:01 Animal 1     3
    ## # … with 1,483 more rows

## Working with tracks

### Utility functions

#### Basic manipulation

Remember, that a `track_xy*` behaves like regular a `data.frame`. This means that we can use all data manipulation verbs that we are used to from `base` R or the `tidyverse`. For example, we can filter a track based on some characteristic. As an example we extract all relocations from the month May.

    tr3 <- tr2 %>% filter(month == 5)

    # we are left with a track
    class(tr3)

    ## [1] "track_xyt"  "track_xy"   "tbl_df"     "tbl"        "data.frame"

#### Transforming CRS

If we set the CRS when creating a track (we can verify this with `has_crs`), we can transform the CRS of the coordinates with the function `transform_coords` (a wrapper around `sp::spTransform`). For illustration, we will transform the CRS of `tr2` to geographical coordinates (EPSG:4326).

    transform_coords(tr2, sp::CRS("+init=epsg:4326"))

    ## # A tibble: 1,493 x 5
    ##       x_    y_ t_                  id       month
    ##  * <dbl> <dbl> <dttm>              <chr>    <dbl>
    ##  1  9.89  54.1 2008-03-30 00:01:47 Animal 1     3
    ##  2  9.89  54.1 2008-03-30 06:00:54 Animal 1     3
    ##  3  9.89  54.1 2008-03-30 12:01:47 Animal 1     3
    ##  4  9.89  54.1 2008-03-30 18:01:24 Animal 1     3
    ##  5  9.89  54.1 2008-03-30 18:25:56 Animal 1     3
    ##  6  9.89  54.1 2008-03-30 18:26:05 Animal 1     3
    ##  7  9.89  54.1 2008-03-30 18:26:14 Animal 1     3
    ##  8  9.89  54.1 2008-03-30 18:26:24 Animal 1     3
    ##  9  9.89  54.1 2008-03-30 18:26:33 Animal 1     3
    ## 10  9.89  54.1 2008-03-30 18:38:01 Animal 1     3
    ## # … with 1,483 more rows

### Some initial data exploration

Several functions for calculating derived quantities are available. We will start with looking at step length. The function `step_lengths` can be used for this.

    tr2 <- tr2 %>% mutate(sl_ = step_lengths(.))

If we look at a summary of `sl_` we note two things:

    summary(tr2$sl_)

    ##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max.    NA's
    ##    0.00   35.01  105.33  249.07  297.75 4727.86       1

Note, 1) there is a `NA` for the last step length, this is expected because we are still in a point representation (i.e., there is no step length for the last relocation). 2) the range is fairly large ranging from 0 to almost 5 km. Before looking at step lengths in any further detail, we will have to make sure the sampling rate is more or less regular (i.e., the same time step between any two points).

The function `summarize_sampling_rate` provides an easy way to look at the sampling rate.

    summarize_sampling_rate(tr2)

    ## # A tibble: 1 x 9
    ##      min    q1 median  mean    q3   max    sd     n unit
    ##    <dbl> <dbl>  <dbl> <dbl> <dbl> <dbl> <dbl> <int> <chr>
    ## 1 0.0025  2.00   2.01  6.34  6.00 3924.  102.  1492 hour

This suggests that a sampling rate for 6 hours might be adequat. We can then use the function `track_resample` to resample the track and only keep relocations that are approximately 6 hours apart (within some tolerance, that can be specified). We will use the function `lubridate::hours` to specify the sampling rate and `lubridate::minutes` to specify the tolerance. Both arguments `rate` and `tolerance` are expected to be a `Period`.

    tr3 <- tr2 %>% track_resample(rate = hours(6), tolerance = minutes(20))
    tr3

    ## # A tibble: 826 x 7
    ##         x_      y_ t_                  id       month    sl_ burst_
    ##  *   <int>   <int> <dttm>              <chr>    <dbl>  <dbl>  <dbl>
    ##  1 3558528 5999094 2008-03-30 00:01:47 Animal 1     3  41.8       1
    ##  2 3558513 5999055 2008-03-30 06:00:54 Animal 1     3 104.        1
    ##  3 3558564 5999146 2008-03-30 12:01:47 Animal 1     3  95.3       1
    ##  4 3558504 5999072 2008-03-30 18:01:24 Animal 1     3  22.8       1
    ##  5 3557474 5999130 2008-03-31 00:01:23 Animal 1     3 155.        1
    ##  6 3557319 5999127 2008-03-31 06:01:45 Animal 1     3   6.08      1
    ##  7 3557313 5999126 2008-03-31 12:01:11 Animal 1     3   4.47      1
    ##  8 3557317 5999128 2008-03-31 18:01:55 Animal 1     3 113.        1
    ##  9 3557204 5999130 2008-04-01 00:01:24 Animal 1     4 187.        1
    ## 10 3557108 5999291 2008-04-01 06:00:54 Animal 1     4   6.32      1
    ## # … with 816 more rows

`tr3` still a track, but with two differenes compared to `tr2`. 1) the number of rows is reduced from 1493 to 826, because only relocations that are 6 hours +/- the tolerance apart of each other are retained; 2) `tr3` has one new column called `burst_`. A burst is sequence of relocatoins with equal sampling rates. Consider the following hypothetical example: 5 relocations are all 6 hours apart. Then there is a gap of 12 hours because one relocation failed and afterwards then there are an other 10 relocations all 6 hours apart. Then we would consider the first 5 relocations as a burst and the second 10 relocations (after the 12 hour gap) as a second burst.

### From tracks to steps

In many situations we are more interested in steps (that is the animal moving from one relocation to an other, or the straight line between a start and a end point), that in the individual relocatoins. `amt` supports `steps` as an other way to represent movement data. The transition from a track to steps can be done via two functions.

1. `steps`: Takes as an input a track, converts the track to step and calculating some derived quantities (e.g., step lengths, turning angles). The function `steps` to receive a track with regular sampling rates.
2. `steps_by_burst`: Takes as an input a resampled track (i.e., a track with several bursts) and will calcualte derived quantities per burst.

## How to deal with several animals

Up to now we have only considered situations with one animal. However, in most telemetry studies more than one animal are tracked and we often want to calcuated movement relevant characteristics for several aniamls individually. `amt` does not provide a infrastructure for dealing with several animal, however, `list`-columns from the `tidyverse` can be used to manage many animals. Because a track is just a `data_frame` all `tidyverse` verbs can be used. The general strategy consists of 4 steps:

1. Group a track by one or more grouping variables using the function `group_by`.
2. Nest a grouped track. This retaains the unique values of the grouping variable(s) and creates a new column called `data`. The data column is a so called `list`-column. This means it is an R list that contains a `data_frame` for each group.
3. Now we can perform operations on the grouped data creating a new list columnt. This can be done in a combination with `mutate` and `map` (instead of `map` also `lapply` could be used).
4. Select the relevant columns and unnest. With `select` we can select columns of interest and reverse the nesting with the function `unnest`.

As an example we will use a second data set included in `amt` on tracks of four fishers. We will load the data, create a track, resample the tracks individually to 30 min and create a histogram of step lengths (accounting for bursts).

We start by loading the data and creating a track of all individuals together

    data("amt_fisher")
    trk <- amt_fisher %>% make_track(x_, y_, t_, id = id)

    ## .t found, creating `track_xyt`.

Next, we group the track by `id` and nest the track.

    trk1 <- trk %>% nest(data = -"id")
    trk1

    ## # A tibble: 4 x 2
    ##      id data
    ##   <int> <list>
    ## 1  1469 <tibble [1,313 × 3]>
    ## 2  1466 <tibble [702 × 3]>
    ## 3  1078 <tibble [1,200 × 3]>
    ## 4  1072 <tibble [1,205 × 3]>

We now want to resample each track to 30 minutes with a tolerance of 5 minutes and create steps for each animal. For the first animal we would do as follows:

    # get the data for the first animal
    x <- trk1$data[[1]]

    # apply the data analysis
    x %>% track_resample(rate = minutes(30), tolerance = minutes(5)) %>% steps_by_burst()

    ## # A tibble: 145 x 10
    ##    burst_    x1_    x2_    y1_    y2_   sl_    ta_ t1_
    ##  *  <dbl>  <dbl>  <dbl>  <dbl>  <dbl> <dbl>  <dbl> <dttm>
    ##  1      1 1.79e6 1.79e6 2.40e6 2.40e6 438.  NA     2011-02-01 00:02:24
    ##  2      1 1.79e6 1.79e6 2.40e6 2.40e6 619.  -2.08  2011-02-01 00:30:46
    ##  3      1 1.79e6 1.79e6 2.40e6 2.40e6 610.   0.707 2011-02-01 00:56:10
    ##  4      2 1.79e6 1.79e6 2.40e6 2.40e6 462.  NA     2011-02-01 02:55:12
    ##  5      2 1.79e6 1.79e6 2.40e6 2.40e6 595.   3.01  2011-02-01 03:24:08
    ##  6      2 1.79e6 1.79e6 2.40e6 2.40e6 421.   2.81  2011-02-01 03:49:23
    ##  7      2 1.79e6 1.79e6 2.40e6 2.40e6 553.   0.716 2011-02-01 04:18:29
    ##  8      2 1.79e6 1.79e6 2.40e6 2.40e6 749.   2.88  2011-02-01 04:44:41
    ##  9      4 1.79e6 1.79e6 2.40e6 2.40e6 111.  NA     2011-02-01 23:18:49
    ## 10      4 1.79e6 1.79e6 2.40e6 2.40e6  13.4 -1.76  2011-02-01 23:44:07
    ## # … with 135 more rows, and 2 more variables: t2_ <dttm>, dt_ <drtn>

We now want to apply exactly the same logic to all animals. We can do this by using a `map` and save the results to a new column using `mutate`.

    trk2 <- trk1 %>%
      mutate(steps = map(data, function(x)
        x %>% track_resample(rate = minutes(30), tolerance = minutes(5)) %>% steps_by_burst()))

    trk2

    ## # A tibble: 4 x 3
    ##      id data                 steps
    ##   <int> <list>               <list>
    ## 1  1469 <tibble [1,313 × 3]> <tibble [145 × 10]>
    ## 2  1466 <tibble [702 × 3]>   <tibble [74 × 10]>
    ## 3  1078 <tibble [1,200 × 3]> <tibble [373 × 10]>
    ## 4  1072 <tibble [1,205 × 3]> <tibble [373 × 10]>

Finally, we can select `id` and `steps`, unnest the new `data_frame` and create a plot of the step-length distributions.

    trk2 %>% select(id, steps) %>% unnest(cols = "steps") %>%
      ggplot(aes(sl_, fill = factor(id))) + geom_density(alpha = 0.4)

## Session

    sessioninfo::session_info()

    ## ─ Session info ──────────────────────────────────────────────────────────
    ##  setting  value
    ##  version  R version 3.6.3 (2020-02-29)
    ##  os       Ubuntu 18.04.4 LTS
    ##  system   x86_64, linux-gnu
    ##  ui       X11
    ##  language en_US:en
    ##  collate  C
    ##  ctype    en_US.UTF-8
    ##  tz       Europe/Berlin
    ##  date     2020-03-30
    ##
    ## ─ Packages ──────────────────────────────────────────────────────────────
    ##  package     * version      date       lib
    ##  amt         * 0.0.9        2020-03-30 [1]
    ##  assertthat    0.2.1        2019-03-21 [3]
    ##  cli           2.0.2        2020-02-28 [3]
    ##  codetools     0.2-16       2018-12-24 [6]
    ##  colorspace    1.4-1        2019-03-18 [3]
    ##  crayon        1.3.4        2017-09-16 [3]
    ##  digest        0.6.25       2020-02-23 [3]
    ##  dplyr       * 0.8.5        2020-03-07 [3]
    ##  evaluate      0.14         2019-05-28 [3]
    ##  fansi         0.4.1        2020-01-08 [3]
    ##  farver        2.0.3        2020-01-16 [3]
    ##  ggplot2     * 3.3.0        2020-03-05 [3]
    ##  glue          1.3.2        2020-03-12 [3]
    ##  gtable        0.3.0        2019-03-25 [3]
    ##  htmltools     0.4.0        2019-10-04 [3]
    ##  knitr       * 1.25         2019-09-18 [3]
    ##  labeling      0.3          2014-08-23 [3]
    ##  lattice       0.20-40      2020-02-19 [6]
    ##  lazyeval      0.2.2        2019-03-15 [3]
    ##  lifecycle     0.2.0        2020-03-06 [3]
    ##  lubridate   * 1.7.4        2018-04-11 [3]
    ##  magrittr      1.5          2014-11-22 [3]
    ##  Matrix        1.2-17       2019-03-22 [6]
    ##  munsell       0.5.0        2018-06-12 [3]
    ##  pillar        1.4.3        2019-12-20 [3]
    ##  pkgconfig     2.0.3        2019-09-22 [3]
    ##  purrr         0.3.3        2019-10-18 [3]
    ##  R6            2.4.1        2019-11-12 [3]
    ##  raster      * 3.0-12       2020-01-30 [3]
    ##  Rcpp          1.0.4        2020-03-17 [3]
    ##  rgdal         1.4-8        2019-11-27 [3]
    ##  rlang         0.4.5        2020-03-01 [3]
    ##  rmarkdown     2.0          2019-12-12 [3]
    ##  scales        1.1.0        2019-11-18 [3]
    ##  sessioninfo   1.1.1        2018-11-05 [3]
    ##  sp          * 1.4-1        2020-02-28 [3]
    ##  stringi       1.4.6        2020-02-17 [3]
    ##  stringr       1.4.0        2019-02-10 [3]
    ##  survival      3.1-8        2019-12-03 [3]
    ##  tibble        2.99.99.9014 2020-03-24 [3]
    ##  tidyr         1.0.2        2020-01-24 [3]
    ##  tidyselect    1.0.0        2020-01-27 [3]
    ##  utf8          1.1.4        2018-05-24 [3]
    ##  vctrs         0.2.4        2020-03-10 [3]
    ##  withr         2.1.2        2018-03-15 [3]
    ##  xfun          0.12         2020-01-13 [3]
    ##  yaml          2.2.1        2020-02-01 [3]
    ##  source
    ##  local
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.0)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.2)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.3)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.3)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  Github (tidyverse/tibble@96af653)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.1)
    ##  CRAN (R 3.6.3)
    ##
    ## [1] /tmp/RtmpJdj1kQ/Rinst24b358191ad9
    ## [2] /tmp/RtmpRDXPYD/temp_libpath34da760f58d3
    ## [3] /home/jsigner/R/x86_64-pc-linux-gnu-library/3.6
    ## [4] /usr/local/lib/R/site-library
    ## [5] /usr/lib/R/site-library
    ## [6] /usr/lib/R/library