import pandas as pd
from pandas.tseries import offsets
import numpy as np
import datetime as dt
import yaml
import matplotlib.pyplot as plt
from matplotlib.pyplot import cm
import matplotlib.ticker as mtick
from matplotlib.ticker import (MultipleLocator, FormatStrFormatter,
AutoMinorLocator, NullLocator)
import matplotlib.dates as mdates
import seaborn as sns
Data analyzed:
csv_opts = {'sep': '|',
'quotechar': '"',
'compression': 'gzip',
'encoding': 'utf-8'}
# Import and test asserts for UWCHR segregation log dataset
srms1 = pd.read_csv('input/srms-1.csv.gz',
parse_dates=['placement_date', 'release_date'],
**csv_opts)
assert len(srms1[srms1['release_date'] < srms1['placement_date']]) == 0
assert len(srms1) == len(set(srms1['tracking_number']))
assert len(srms1) == len(set(srms1['hashid']))
assert sum(srms1['placement_date'].isnull()) == 0
In a separate process, the document released by ICE (2018-ICFO-00515 Highlighted_EDIT.xlsx
) has been edited to remove fields containing unredacted sensitive and personally-identifiable information; converted to CSV format and compressed; and minimally cleaned. The resulting file, srms-1.csv.gz
, is described and analyzed in the continuing sections. Code for this process is available for review upon request.
The dataset released to UWCHR includes 371 records of solitary confinement placements at the Northwest Detention Center. Each record relates to a specific solitary confinement "placement". Names and A-numbers of detained people are redacted from the dataset, making it difficult to determine whether any records relate to detainees experiencing multiple solitary confinement placements; however, comment fields excluded from the public version of this dataset make clear that some represent repeat placements.
The earliest placement date (start of solitary stay) was May 13, 2013 and the latest placement date was May 20, 2018. The earliest release date (end of solitary stay) was July 16, 2013 and the latest release date was May 31, 2018.
The maximum number of solitary confinement placements in a single month was 18 in December 2013. The overall average number of solitary placements per month was 6.08.
Figure 1: Total monthly solitary confinement placements at NWDC
340 people placed in solitary were male, 31 were female. People placed in solitary confinement at NWDC were from 55 countries. The top 5 countries of citizenship are listed in Table 1 below.
Table 1: Top five countries of citizenship of detainees placed in solitary confinement at NWDC
Country of Citizenship | NWDC Solitary Placements |
---|---|
Mexico | 194 |
Canada | 20 |
Guatemala | 18 |
El Salvador | 17 |
Somalia | 13 |
All Others | 109 |
14 records do not have a release_date
specified. All of these records are segregation placements beginning during the latter portion of the dataset, which suggests that these refer to individuals who remained in segregation at the time of production of this dataset.[1] For purposes of analysis of placement length, we exclude these records, leaving 357 completed solitary placements.
The maximum completed segregation placement length was 781 days. The average segregation placement length was 59.61 days and the median segregation placement length was 30 days. The most common placement length was 32 days.
The median and mode values are close to ICE's maximum length of 30 days for most disciplinary segregation placements.[2] 50.14% of placements were for 30 days or less, and 49.86% of placements were for more than 30 days.
67, or 18.77% of placements were for 15 days or less, and 290, or 81.23% of placements were for more than 15 days. Under the United Nations Standard Minimum Rules for the Treatment of Prisoners, segregation for more than 15 consecutive days is prohibited. Note that ICE regulations do not require reporting of all segregation placements, as described above.
The following histogram chart displays the distribution of length of stay for completed segregation placements:
Figure 2: Distribution of length of completed segregation placements (days_solitary
) at NWDC
Each solitary placement is categorized with one of 16 placement reasons (including "Other"). As mentioned above, the maximum solitary length for most "Disciplinary" placements is 30 days.
We can also aggregate these placement reasons into broader categories for comparison, as in the following figure:
Figure 3: Distribution of variable days_solitary
by placement_reason_type
As seen in the following table describing the lenth of solitary placement for each detailed placement type, the most frequently used reasons include broad categories such as "Disciplinary", "Protective Custody: Other Detainee Safety" and "Facility Security Threat: Other".
Table 2: Description of variable days_solitary
grouped by placement_reason
count | mean | std | min | 25% | 50% | 75% | max | |
---|---|---|---|---|---|---|---|---|
placement_reason | ||||||||
Disciplinary | 128 | 25.52 | 25.84 | 2 | 17.00 | 22.5 | 30.00 | 288 |
Protective Custody: Other Detainee Safety | 81 | 92.37 | 106.72 | 2 | 27.00 | 59.0 | 121.00 | 691 |
Facility Security Threat: Other | 33 | 55.00 | 40.28 | 12 | 27.00 | 36.0 | 86.00 | 162 |
Protective Custody: Gang Status (Protective Custody Only) | 25 | 138.92 | 129.96 | 4 | 39.00 | 83.0 | 207.00 | 423 |
Facility Security Threat: Violent or Disruptive Behavior | 23 | 54.78 | 36.46 | 6 | 30.00 | 44.0 | 82.50 | 133 |
Facility Security Threat: Gang Member Status (Not Protective Custody) | 19 | 68.53 | 110.71 | 7 | 28.50 | 34.0 | 61.50 | 509 |
Medical: Observation | 9 | 8.78 | 7.56 | 1 | 1.00 | 7.0 | 15.00 | 20 |
Mental Illness | 9 | 41.67 | 43.67 | 4 | 21.00 | 28.0 | 44.00 | 147 |
Pending Investigation of Disciplinary Violation | 8 | 6.75 | 3.37 | 2 | 4.00 | 7.0 | 8.50 | 12 |
Protective Custody: Criminal Offense (i.e. Sex Offender) | 8 | 217.75 | 234.76 | 39 | 118.00 | 144.0 | 177.50 | 781 |
Medical: Other | 4 | 14.50 | 12.4 | 3 | 8.25 | 11.5 | 17.75 | 32 |
Other | 3 | 23.67 | 20.6 | 2 | 14.00 | 26.0 | 34.50 | 43 |
Protective Custody: Special Vulnerability Other | 3 | 26.67 | 17.04 | 9 | 18.50 | 28.0 | 35.50 | 43 |
Facility Security Threat: Due to Seriousness of Criminal Conviction | 2 | 50.00 | 25.46 | 32 | 41.00 | 50.0 | 59.00 | 68 |
Hunger Strike | 1 | 4.00 | 4 | 4.00 | 4.0 | 4.00 | 4 | |
Protective Custody: Lesbian, Gay, Bisexual, Transgender (LGBT) | 1 | 118.00 | 118 | 118.00 | 118.0 | 118.00 | 118 |
Application of different placement reason categories varies over time, as seen in the following figure, which shows trends in the proportion of placement reasons per fiscal year period. Note the proportional decrease in "Disciplinary" placements (which involve an administrative hearing process), and increase in "Protective Custody" and "Facility Security Threat" placements, which tend to be longer on average than disciplinary placements.
Figure 4: NWDC segregation placement reason categories as proportion of total placements
We can also illustrate placement reason and stay lengths over time. Note the frequent disciplinary placements during late FY2012 and FY2013 with stay lengths around 15-40 days, and the cluster of long "Facility Security Threat" placements during FY2016:
Figure 5: NWDC segregation placements by reason and stay length over time
While "Mental Illness" is occasionally employed as a placement_reason
value, all records also include a mental_illness
field indicating whether the detained person has been diagnosed with a mental illness or serious mental illness. 116, or 31.27% of records indicate a "Mental Illness" diagnosis; 18, or 4.85% of records indicate a diagnosis of "Serious Mental Illness". Remaining records indicate no mental illness diagnosis.
Figure 6: Count of placements by mental_illness
Category
As shown in the preceding section, 9 records indicate a placement_reason
of "Mental Illness". Of these records, 3 indicate a mental_illness
value of "None".
As illustrated in the following table and chart, stay lengths for individuals with a "Mental Illness" diagnosis tended to be shorter than those without. However, stay lengths for individuals with a "Serious Mental Illness" diagnosis tended to be longer:
Table 3: Description of variable days_solitary
grouped by mental_illness
count | mean | std | min | 25% | 50% | 75% | max | |
---|---|---|---|---|---|---|---|---|
mental_illness | ||||||||
None | 228 | 61.63 | 91.17 | 1 | 22.00 | 31.5 | 62.00 | 781 |
Mental Illness | 111 | 49.11 | 80.81 | 1 | 8.00 | 20.0 | 50.50 | 509 |
Serious Mental Illness | 18 | 98.67 | 86.69 | 5 | 52.25 | 86.0 | 110.75 | 327 |
Figure 7: Distribution of variable days_solitary
by mental_illness
Each placement is coded as either "Facility-Initiated" (264 placements) or "Detainee Request" (107 placements). As seen in the below table, the majority of reported detainee requested placements were for "Protective Custody", with a small minority classified as "Other."
Average stay lengths for "Detainee Request" placements were considerably longer than for "Facility-Initiated" placements (118.99 versus 36.18) days; however, we note that stay lengths vary greatly, as seen in the following figure.
Figure 8: Distribution of variable days_solitary
grouped by detainee_request
```
Table 4: Description of variable days_solitary
grouped by detainee_request
and placement_reason_type
count | mean | std | min | 25% | 50% | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
detainee_request | placement_reason_type | ||||||||
Detainee Request | Other | 2 | 34.50 | 12.02 | 26 | 30.25 | 34.5 | 38.75 | 43 |
Protective Custody | 99 | 120.70 | 133.16 | 3 | 33.50 | 74.0 | 154.50 | 781 | |
Facility-Initiated | Disciplinary | 128 | 25.52 | 25.84 | 2 | 17.00 | 22.5 | 30.00 | 288 |
Facility Security Threat | 77 | 58.14 | 63.37 | 6 | 27.00 | 39.0 | 72.00 | 509 | |
Hunger Strike | 1 | 4.00 | 4 | 4.00 | 4.0 | 4.00 | 4 | ||
Medical | 13 | 10.54 | 9.17 | 1 | 3.00 | 8.0 | 15.00 | 32 | |
Mental Illness | 9 | 41.67 | 43.67 | 4 | 21.00 | 28.0 | 44.00 | 147 | |
Other | 1 | 2.00 | 2 | 2.00 | 2.0 | 2.00 | 2 | ||
Pending Disciplinary | 8 | 6.75 | 3.37 | 2 | 4.00 | 7.0 | 8.50 | 12 | |
Protective Custody | 19 | 49.79 | 49.92 | 2 | 12.00 | 35.0 | 68.00 | 175 |
[1] No records are missing placement_date
values, and no record has a release_date
preceding its placement_date
.
[2] See Section 2.12 "Special Management Units" in ICE’s detention standards manual: https://www.ice.gov/doclib/detention-standards/2011/2-12.pdf