Latest Trends in Religious Restrictions and Hostilities

Appendix 1: Methodology

This is the sixth time the Pew Research Center has measured restrictions on religion around the globe.⁴⁴ This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below.

Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.⁴⁵ This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013.

The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.)

Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category.

Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.⁴⁶ The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated.

This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary.

Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders.

Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country.

Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.⁴⁷ Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis.

Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions.

The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions
2. U.S. State Department annual reports on International Religious Freedom
3. U.S. Commission on International Religious Freedom annual reports
4. U.N. Special Rapporteur on Freedom of Religion or Belief reports
5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding
6. Human Rights Watch topical reports
7. International Crisis Group country reports
8. United Kingdom Foreign & Commonwealth Office annual report on human rights
9. Council of the European Union annual report on human rights
10. Global Terrorism Database
11. European Network Against Racism Shadow Reports
12. United Nations High Commissioner for Refugees reports
13. U.S. State Department annual Country Reports on Terrorism
14. Anti-Defamation League reports
15. U.S. State Department Country Reports on Human Rights Practices
16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database
17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters

U.S. government reports with information on the situation in the United States
• U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports
• FBI Hate Crime Reports

One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study.

As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database.

The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world.

In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available.

While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrument

As explained in more detail below, Pew Research staff developed a battery of questions similar to a survey questionnaire. Coders consulted the primary sources in order to answer the questions separately for each country. While the State Department’s annual reports on International Religious Freedom generally contained the most comprehensive information, the other sources provided additional factual detail that was used to settle ambiguities, resolve contradictions and help in the proper scoring of each question.

The questionnaire, or coding instrument, generated a set of numerical measures on restrictions in each country. It also made it possible to see how government restrictions intersect with broader social tensions and incidents of violence or intimidation by private actors. The coding instrument with the list of questions used for this report is shown in the Summary of Results starting on page 64.

The coding process required the coders to check all the sources for each country. Coders determined whether each source provided information critical to assigning a score; had supporting information but did not result in new facts; or had no available information on that particular country. Multiple sources of information were available for all countries and self-administering territories with populations greater than 1 million. Most of the countries and territories analyzed by the Pew Research Center were multi-sourced; only small, predominantly island, countries had a single source, namely, the State Department reports.
Coding the United States presented a special problem since it is not included in the State Department’s annual reports on International Religious Freedom. Accordingly, Pew Research coders also looked at reports from the U.S. Department of Justice and the FBI on violations of religious freedom in the United States, in addition to consulting all the primary sources, including reports by the United Nations, Human Rights Watch, Freedom House, the International Crisis Group and the U.K. Foreign & Commonwealth Office, many of which contain data on the United States.

The Coding Process

The Pew Research Center employed strict training and rigorous coding protocols to make its coding as objective and reproducible as possible. Coders worked directly under an experienced researcher’s supervision, with additional direction and support provided by other Pew Research Center researchers. The coders underwent an intensive training period that included a thorough overview of the research objectives, information sources and Methodology.

Countries were double-blind coded by two coders (coders did not see each other’s ratings), and the initial ratings were entered into an electronic document (coding instrument) including details on each incident. The coders began by filling out the coding instrument for each country using the information source that had the most comprehensive information. The protocol for each coder was to answer every question on which information was available in the initial source. Once a coder had completed that process, he or she then turned to the other sources. As new information was found, this was also coded and the source duly noted. Whenever ambiguities or contradictions arose, the source providing the most detailed, clearly documented evidence was used.

After two coders had separately completed the coding instrument for a particular country, their scores were compared by a research associate. Areas of discrepancy were discussed at length with the coders and were reconciled in order to arrive at a single score on each question for each country. The data for each country were then combined into a master file, and the answers and substantiating evidence were entered into a database.

The coding procedures used in the latest report varied somewhat from previous years because of the relatively late release of the U.S. State Department’s International Religious Freedom report, which was made public in July 2014. Prior to the release of the State Department report, Pew Research coders completed the coding procedure for each country using all other available sources. After the State Department released the International Religious Freedom report, the coders went back over each country and updated their coding as necessary.

After data collection for all countries was completed, Pew Research coders and researchers compared the scores from calendar year 2013 with those from the previous year, ending Dec. 31, 2012. They identified scores that had changed and analyzed the substantiating evidence for each year to make sure the change was substantive and not the result of coder error. Throughout this process, the coding instrument itself was continually monitored for possible defects. The questions were designed to be precise, comprehensive and objective so that, based on the same data and definitions, the coding could be reliably reproduced by others with the same results. At the same time, the Pew Research Center has attempted to minimize changes to the coding instrument as much as is possible to ensure all changes between years are the result of actual changes in restrictions and hostilities, not changes in methodology.

Pew Research staff generally found few cases in which one source contradicted another. When contradictions did arise – such as when sources provided differing estimates of the number of people displaced due to religion-related violence – the source that cited the most specific documentation was used. The coders were instructed to disregard broad, unsubstantiated generalizations regarding abuses and to focus on reports that contained clear, precise documentation and factual details, such as names, dates and places where incidents occurred.

Pew Research staff compared coders’ scores for all questions for each of the 198 countries and territories included in the study, computing the degree to which the scores matched. The inter-rater reliability score across all variables was 0.74. Scores above 0.7 are generally considered good.

The data-verification procedures went beyond the inter-rater reliability statistics. They also involved comparing the answers on the main measures for each country with other closely related questions in the data set. This provided a practical way to test the internal reliability of the data.

In previous years, Pew Research staff also checked the reliability of the coded data by comparing them with similar, though more limited, religious restrictions data sets. In particular, published government and social regulation of religion index scores are available from the Association of Religion Data Archives (for three years of data) and the Hudson Institute (for one year of data), which makes them ideal measures for cross-validation. The review process found very few significant discrepancies in the coded data; changes were made only if warranted by a further review of the primary sources.

Restriction of Religion Indexes

The Government Restrictions Index is based on 20 indicators of ways that national and local governments restrict religion, including through coercion and force. The Social Hostilities Index is based on 13 indicators of ways in which private individuals and social groups infringe on religious beliefs and practices, including religiously biased crimes, mob violence and efforts to stop particular religious groups from growing or operating. The study also counted the number and types of documented incidents of religion-related violence, including terrorism and armed conflict.

Government Restrictions Index

Coding multiple indicators makes it possible to construct a Government Restrictions Index of sufficient gradation to allow for meaningful cross-national comparisons. An additional advantage of using multiple indicators is that it helps mitigate the effects of measurement error in any one variable, providing greater confidence in the overall measure.

The Pew Research Center coded 20 indicators of government restrictions on religion (see the Summary of Results). These 20 items were added together to create the GRI. In two cases, these items represent an aggregation of several closely related questions: Measures of five types of physical abuses are combined into a single variable (GRI Q.19), and seven questions measuring aspects of government favoritism are combined into an overall favoritism scale. (GRI Q.20 is a summary variable showing whether a country received the maximum score on one or more of the seven questions.)

The GRI is a fine-grained measure created by adding the 20 items on a 0-to-10 metric, with zero indicating very low levels of government restrictions on religion and 10 indicating very high levels of restrictions. The 20 questions that form the GRI are coded in a standard scale from zero to one point, while gradations among the answers allowed for partial points to be given for lesser degrees of the particular government restriction being measured. The overall value of the index was calculated and proportionally adjusted – so that it had a maximum value of 10 and a possible range of zero to 10 – by dividing the sum of the variables by two.

A test of whether the 20 items were statistically reliable as a single index produced a scale reliability coefficient of 0.91 for calendar year 2013. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these 20 items into a single index.

Social Hostilities Index

In addition to government restrictions, violence and intimidation in societies also can limit religious beliefs and practices. Accordingly, Pew Research staff tracked more than a dozen indicators of social impediments on religion. Once again, coding multiple indicators made it possible to construct an index that shows gradations of severity or intensity and allows for comparisons among countries. The Summary of Results contains the 13 items used by Pew Research staff to create the Social Hostilities Index.

The SHI was constructed by adding together the 13 indicators based on a 0-to-10 metric, with zero indicating very low impediments to religious beliefs and practices and 10 indicating very high impediments. The various questions that form the index are coded in a standard scale from zero to one point, while gradations among the answers allow for partial points to be given for lesser degrees of the particular hostilities being measured. The indicators were added together and set to have a possible range of zero to 10 by dividing the sum of the variables by 1.3.

As with the Government Restrictions Index, various types of violence and intimidation were combined. A test of whether these 13 items were statistically reliable as a single index produced a scale reliability coefficient of 0.89. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these items into a single index.

How Examples Are Coded

Examples of each type of government restriction or social hostility are generally counted in a single measure on the GRI or SHI. For instance, a restriction on proselytizing (sharing one’s faith with the intent of persuading another to join the faith) is not also counted as a restriction on conversion (an individual changing his/her religion). In some situations, however, an individual restriction or hostility may be part of a broader set of restrictions or hostilities. For instance, a mob attack by members of one religious group on an individual of another religion may be an isolated event and counted just under question SHI Q.2: Was there mob violence related to religion? (See the Summary of Results.) However, if such an attack triggers repeated attacks between religious groups, it also might be an indication of sectarian or communal violence, which by definition involves two or more religious groups facing off in repeated clashes. In such a case, the mob attack also would be counted under question SHI Q.3: Were there acts of sectarian or communal violence between religious groups? (See the Summary of Results.)

Effects of Consolidating to a New Database

For the first few years of this study, information on the number, types and locations of incidents of government force and social violence toward religious groups as well as deference to religious authorities in matters of law were coded at the province level. (See example of data coding on pages 45-48 of the December 2009 baseline report.) Each year, the province numbers were summed and put into separate country-level files. Following the publication of the August 2011 report, Pew Research staff created a database that integrated all province- and country-level data on religious restrictions. During this process, Pew Research staff reviewed any discrepancies between province files and the sums that had been transferred to the country files and made appropriate corrections. The adjustments made were relatively minor and had small effects on index scores for countries, on average less than 0.005 points on the 10-point indexes. Consolidating the data into a database also entailed a review of the data on harassment of religious groups. In particular, instances of harassment from the year ending in mid-2007 were stored as open-ended questions, and in a few cases they were recoded to match the categories used in subsequent years.

Beginning in 2013, Pew Research stopped collecting data at the province-level; all data is coded at the country level.

Changing Time Period of Analysis

This is the third time Pew Research has analyzed restrictions on religion in a calendar year. Previous reports analyzed 12-month periods from July 1-June 30 (e.g., July 1, 2009-June 30, 2010). The shift to calendar years was made, in part, because most of the primary sources used in this study are based on calendar years.

Because of the shift in time frame, previous studies did not report directly on incidents that occurred during the period from July 1-Dec. 31, 2010. While this misses some incidents that occurred during the second half of 2010, events that had an ongoing impact – such as a change to a country’s constitution or the outbreak of a religion-related war – were captured by the coding. Researchers for the study carefully reviewed the situation in each country and territory during this six-month period and made sure that restrictions with an ongoing impact were not overlooked.

Religion-Related Terrorism and Armed Conflict

Terrorism and war can have huge direct and indirect effects on religious groups, including destroying religious sites, displacing whole communities and inflaming sectarian passions. Accordingly, Pew Research tallied the number, location and consequences of religion-related terrorism and armed conflict around the world, as reported in the same primary sources used to document other forms of intimidation and violence. However, war and terrorism are sufficiently complex that it is not always possible to determine the degree to which they are religiously motivated or state sponsored. Out of an abundance of caution, this study does not include them in the Government Restrictions Index. They are factored instead into the index of social hostilities involving religion, which includes one question specifically about religion-related terrorism and one question specifically about religion-related war or armed conflict. In addition, other measures in both indexes are likely to pick up spillover effects of war and terrorism on the level of religious tensions in society. For example, hate crimes, mob violence and sectarian fighting that occur in the aftermath of a terrorist attack or in the context of a religion-related war would be counted in the Social Hostilities Index, and laws or policies that clearly discriminate against a particular religious group would be registered on the Government Restrictions Index.

For the purposes of this study, the term “religion-related terrorism” is defined as premeditated, politically motivated violence perpetrated against noncombatant affects by subnational groups or clandestine agents that have some identifiable religious ideology or religious motivation. It also includes acts carried out by groups that have a nonreligious identity but affect religious personnel, such as clergy. Readers should note that it is the political character and motivation of the groups, not the type of violence, that is at issue here. For instance, a bombing would not be classified as religion-related terrorism if there was no clearly discernible religious ideology or bias behind it unless it was directed at religious personnel. Religion-related war or armed conflict is defined as armed conflict (a conflict that involves sustained casualties over time or more than 1,000 battle deaths) in which religious rhetoric is commonly used to justify the use of force, or in which one or more of the combatants primarily identifies itself or the opposing side by religion.

Changes to Somalia’s Coding

In the latest year studied, researchers changed the way they coded government restrictions in Somalia. In previous years of the study, researchers had coded actions by the al-Shabaab rebel group as government restrictions, largely because the group effectively controlled large swathes of Somali territory. The extent of al-Shabaab control over Somali territory decreased in calendar year 2013, so researchers did not code their actions as government restrictions but rather as social hostilities. This contributed to the drop in Somalia’s GRI score, even though actual practices by the government did not change appreciably.

Potential Biases

As noted earlier, the primary sources indicate that the North Korean government is among the most repressive in the world, including toward religion. But because independent observers lack regular access to North Korea, the sources are unable to provide the kind of specific, timely information that forms the basis of this report. Therefore, North Korea is not included on either index.

This raises two important issues concerning potential information bias in the sources. The first is whether other countries that limit outsiders’ access and that may seek to obscure or distort their record on religious restrictions were adequately covered by the sources. Countries with relatively limited access have multiple primary sources of information that the Pew Research Center used for its coding. Each is also covered by other secondary quantitative data sets on religious restrictions that have used a similar coding scheme, including earlier years of coded State Department report data produced by Grim at Penn State’s Association of Religion Data Archives (ARDA) project (four data sets); independent coding by experts at the Hudson Institute’s Center for Religious Liberty using indexes also available from ARDA (one data set); and content analysis of country constitutions conducted by the Becket Fund for Religious Liberty (one data set). Pew Research staff used these for cross-validation. Thus, contrary to what one might expect, even most countries that limit access to information tend to receive fairly extensive coverage by groups that monitor religious restrictions.

The second key question – the flipside of the first – is whether countries that provide freer access to information receive worse scores simply because more information is available on them. As described more fully in the methodology in the baseline report, Pew Research staff compared the length of State Department reports on freer-access countries with those of less-free-access countries. The comparison found that the median number of words was approximately three times as large for the limited-access countries as for the open-access countries. This suggests that problems in freer-access countries are generally not overreported in the State Department reports.

Only when it comes to religion-related violence and intimidation in society do the sources report more problems in the freer-access countries than in the limited-access ones. However, the Social Hostilities Index includes several measures – such as SHI Q.8 (“Did religious groups themselves attempt to prevent other religious groups from being able to operate?”) and SHI Q.11 (“Were women harassed for violating religious dress codes?”) – that are less susceptible to such reporting bias because they capture general social trends or attitudes as well as specific incidents. With these limitations in mind, it appears that the coded information on social hostilities is a fair gauge of the situation in the vast majority of countries and a valuable complement to the information on government restrictions.

Data on social impediments to religious practice can more confidently be used to make comparisons among countries with sufficient openness, which includes more than nine-in-ten countries covered in the coding. An analysis by Grim and Richard Wike, the Pew Research Center’s director of global attitudes research, tested the reliability of the State Department reports on social impediments to religious practice by comparing public opinion data with data coded from the reports in previous years by Grim and experts at Penn State. They concluded that “the understanding of social religious intolerance embodied in the State Department reports is comparable with the results of population surveys and individual expert opinion.”⁴⁸

Coding Harassment of Specific Religious Groups

As in previous reports, this study provides a summary of the number of countries where specific religious groups faced government or social harassment. This is essentially a cross-tabulation of GRI.Q.11 (“Was there harassment or intimidation of religious groups by any level of government?”) and the first type of religious hatred or bias measured in SHI.Q.1.a. (“Did individuals face harassment or intimidation motivated by religious hatred or bias?”). For purposes of this study, the definition of harassment includes any mention in the primary sources of an offense against an individual or group based on religious identity. Such offenses may range from physical attacks and direct coercion to more subtle forms of discrimination. But prejudicial opinions or attitudes, in and of themselves, do not constitute harassment unless they are acted upon in a palpable way.

As noted above, this study provides data on the number of countries in which different religious groups are harassed or intimidated. But the study does not assess either the severity or the frequency of the harassment in each country. Therefore, the results should not be interpreted as gauging which religious group faces the most harassment or persecution around the world.

New Analysis Focused on Religious Minorities

This report includes a new analysis of government restrictions and social hostilities aimed primarily at religious minorities. The analysis relies on new aggregations and calculations of existing measures on the Government Restrictions Index and Social Hostilities Index, as discussed in detail below.

Defining Religious Minorities

For purposes of this analysis, groups that constitute less than 50% of a country’s population are considered religious minorities. This includes subgroups within major religious traditions, such as Roman Catholics and Orthodox Christians and Sunni and Shia Muslims. Including subgroups within religious traditions is important for the study of global restrictions on religion because many of the incidents described in the study’s primary sources focus on intra-religious conflicts and hostilities. When no religious group makes up more than 50% of the population – which is the case in countries with several large religious groups – smaller religious groups are considered religious minorities. For example, if a country’s population included three religious groups that each make up about 30% of the population, the groups that make up the remaining 10% would be considered religious minorities.

Unlike other Pew Research studies that examine the size and distribution of the world’s major religions, this study does not count the religiously unaffiliated as a distinct religious group.

Measuring Restrictions and Hostilities Affecting Religious Minorities

Pew Research Center staff identified a set of components of the Government Restrictions Index and the Social Hostilities Index that tend to target religious minorities. While all government restrictions on religion and social hostilities involving religion affect religious minorities to some extent, a few components of the indexes involve policies or hostilities that are specifically directed at groups out of favor with the government and/or members of society. Since these groups are often religious minorities, these measures were selected as proxies for government policies or social hostilities targeting religious minorities.

In the case of government restrictions, the questions chosen represent restrictions whose primary effect is to restrict the faith practices or threaten the existence of religious groups out of favor with the government through active government initiatives. Pew Research identified three questions that fit this category: GRI Q. 12, GRI Q.16 and GRI Q.17. (For full question wording, see text box on page 50.) In the case of social hostilities, the questions chosen represent social hostilities whose primary effect is to disrupt or harm religious groups that others in society do not approve of. Pew Research identified three questions that fit this category: SHI Q.7, SHI Q.8 and SHI Q.10. (For full question wording, see text box on
page 50.)

The selection of the questions used for this part of the analysis was based on researcher expertise and experience using the data Pew Research has collected over the eight years of this study.

Pew Research Center staff reviewed the incidents coded for the selected questions to determine whether or not they disproportionately affected religious minorities. Staff compared the details of the incident — particularly the religious groups affected — with information on religious demography in the country from the U.S. State Department’s International Religious Freedom Reports, one of the primary sources for the study. (The State Department reports include a detailed section on religious demography for each country.) If the group affected made up less than 50% of the population, staff considered the example of the restriction or hostility as affecting religious minorities. While the coding of these questions captured some incidents that did not involve religious minorities, the majority of the incidents did involve religious minorities, leading us to accept the items as a valid indicator of restrictions and hostilities targeting religious minorities.

Pew Research staff then developed two new variables indicating whether or not a country experienced at least one type of restriction or hostility that tends to target religious minorities. The variable measuring government restrictions is coded as 1 if GRI Q.12, GRI Q.16 or GRI Q.17 is above 0 for that country (indicating the type of restriction was in place). And the variable measuring social hostilities that tend to target religious minorities is coded as 1 if SHI Q.7, SHI Q.8 or SHI Q.10 is above 0 for that country. These two variables thus function in a similar manner as the Government Restrictions Index and Social Hostilities Index; they aggregate multiple specific indicators of religious minorities’ status in a country to measure this concept. The scale reliability coefficient for each aggregate — a measure of the extent to which a set of questions are related — was above 0.7, the acceptable level for reliability.

Limitations of This Approach to the Study of Religious Minorities

This way of measuring the impact of restrictions and hostilities on religious minorities allows the Pew Research Center to do so in a transparent manner, but there are some limitations to this approach. First, this study does not directly measure examples of governments imposing restrictions on religious minorities or social groups committing hostilities against religious minorities. Instead, it focuses on types of government restrictions and social hostilities that tend to target religious minorities. Second, this study does not measure the severity of restrictions or hostilities affecting religious minorities; as a result, any discussion involves analysis of whether or not the restriction or hostility occurred, not how many members of a religious minority it affected. Finally, although the questions used in the two new variables disproportionately affect religious minorities, they may not exclusively affect them; that is, these variables do include some incidents involving groups that are not in the minority.

Other possible approaches would encounter limitations of their own. Coding a new set of variables specifically measuring restrictions or hostilities on religious minorities would require a separate coding effort on the scale of the religious restrictions coding to ensure it is done in a valid and reliable manner. Likewise, it would be difficult to measure the severity or incidents of restrictions or hostilities targeting religious minorities due to issues with information availability. This is similar to the reason the Pew Research Center measures whether or not particular religious groups were harassed in a country, not the extent or severity of the harassment a group faces.

Back to Overview

See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion. ↩
Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories. ↩
See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1. ↩
The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea. ↩
See Grim, Brian J. and Richard Wike. 2010. “Cross-Validating Measures of Global Religious Intolerance: Comparing Coded State De- partment Reports with Survey Data and Expert Opinion.” Politics and Religion, vol. 3, issue 1: 102-129. ↩

his is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below.

Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category.

Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedureshis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territorieshis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sourceshis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013his is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions 2. U.S. State Department annual reports on International Religious Freedom 3. U.S. Commission on International Religious Freedom annual reports 4. U.N. Special Rapporteur on Freedom of Religion or Belief reports 5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding 6. Human Rights Watch topical reports 7. International Crisis Group country reports 8. United Kingdom Foreign & Commonwealth Office annual report on human rights 9. Council of the European Union annual report on human rights 10. Global Terrorism Database 11. European Network Against Racism Shadow Reports 12. United Nations High Commissioner for Refugees reports 13. U.S. State Department annual Country Reports on Terrorism 14. Anti-Defamation League reports 15. U.S. State Department Country Reports on Human Rights Practices 16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database 17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters U.S. government reports with information on the situation in the United States • U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports • FBI Hate Crime Reports One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study. As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database. The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world. In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available. While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrumenthis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions 2. U.S. State Department annual reports on International Religious Freedom 3. U.S. Commission on International Religious Freedom annual reports 4. U.N. Special Rapporteur on Freedom of Religion or Belief reports 5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding 6. Human Rights Watch topical reports 7. International Crisis Group country reports 8. United Kingdom Foreign & Commonwealth Office annual report on human rights 9. Council of the European Union annual report on human rights 10. Global Terrorism Database 11. European Network Against Racism Shadow Reports 12. United Nations High Commissioner for Refugees reports 13. U.S. State Department annual Country Reports on Terrorism 14. Anti-Defamation League reports 15. U.S. State Department Country Reports on Human Rights Practices 16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database 17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters U.S. government reports with information on the situation in the United States • U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports • FBI Hate Crime Reports One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study. As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database. The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world. In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available. While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrument

As explained in more detail below, Pew Research staff developed a battery of questions similar to a survey questionnaire. Coders consulted the primary sources in order to answer the questions separately for each country. While the State Department’s annual reports on International Religious Freedom generally contained the most comprehensive information, the other sources provided additional factual detail that was used to settle ambiguities, resolve contradictions and help in the proper scoring of each question. The questionnaire, or coding instrument, generated a set of numerical measures on restrictions in each country. It also made it possible to see how government restrictions intersect with broader social tensions and incidents of violence or intimidation by private actors. The coding instrument with the list of questions used for this report is shown in the Summary of Results starting on page 64. The coding process required the coders to check all the sources for each country. Coders determined whether each source provided information critical to assigning a score; had supporting information but did not result in new facts; or had no available information on that particular country. Multiple sources of information were available for all countries and self-administering territories with populations greater than 1 million. Most of the countries and territories analyzed by the Pew Research Center were multi-sourced; only small, predominantly island, countries had a single source, namely, the State Department reports. Coding the United States presented a special problem since it is not included in the State Department’s annual reports on International Religious Freedom. Accordingly, Pew Research coders also looked at reports from the U.S. Department of Justice and the FBI on violations of religious freedom in the United States, in addition to consulting all the primary sources, including reports by the United Nations, Human Rights Watch, Freedom House, the International Crisis Group and the U.K. Foreign & Commonwealth Office, many of which contain data on the United States.

The Coding Processhis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions 2. U.S. State Department annual reports on International Religious Freedom 3. U.S. Commission on International Religious Freedom annual reports 4. U.N. Special Rapporteur on Freedom of Religion or Belief reports 5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding 6. Human Rights Watch topical reports 7. International Crisis Group country reports 8. United Kingdom Foreign & Commonwealth Office annual report on human rights 9. Council of the European Union annual report on human rights 10. Global Terrorism Database 11. European Network Against Racism Shadow Reports 12. United Nations High Commissioner for Refugees reports 13. U.S. State Department annual Country Reports on Terrorism 14. Anti-Defamation League reports 15. U.S. State Department Country Reports on Human Rights Practices 16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database 17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters U.S. government reports with information on the situation in the United States • U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports • FBI Hate Crime Reports One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study. As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database. The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world. In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available. While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrument

As explained in more detail below, Pew Research staff developed a battery of questions similar to a survey questionnaire. Coders consulted the primary sources in order to answer the questions separately for each country. While the State Department’s annual reports on International Religious Freedom generally contained the most comprehensive information, the other sources provided additional factual detail that was used to settle ambiguities, resolve contradictions and help in the proper scoring of each question. The questionnaire, or coding instrument, generated a set of numerical measures on restrictions in each country. It also made it possible to see how government restrictions intersect with broader social tensions and incidents of violence or intimidation by private actors. The coding instrument with the list of questions used for this report is shown in the Summary of Results starting on page 64. The coding process required the coders to check all the sources for each country. Coders determined whether each source provided information critical to assigning a score; had supporting information but did not result in new facts; or had no available information on that particular country. Multiple sources of information were available for all countries and self-administering territories with populations greater than 1 million. Most of the countries and territories analyzed by the Pew Research Center were multi-sourced; only small, predominantly island, countries had a single source, namely, the State Department reports. Coding the United States presented a special problem since it is not included in the State Department’s annual reports on International Religious Freedom. Accordingly, Pew Research coders also looked at reports from the U.S. Department of Justice and the FBI on violations of religious freedom in the United States, in addition to consulting all the primary sources, including reports by the United Nations, Human Rights Watch, Freedom House, the International Crisis Group and the U.K. Foreign & Commonwealth Office, many of which contain data on the United States.

The Coding Process

The Pew Research Center employed strict training and rigorous coding protocols to make its coding as objective and reproducible as possible. Coders worked directly under an experienced researcher’s supervision, with additional direction and support provided by other Pew Research Center researchers. The coders underwent an intensive training period that included a thorough overview of the research objectives, information sources and Methodology. Countries were double-blind coded by two coders (coders did not see each other’s ratings), and the initial ratings were entered into an electronic document (coding instrument) including details on each incident. The coders began by filling out the coding instrument for each country using the information source that had the most comprehensive information. The protocol for each coder was to answer every question on which information was available in the initial source. Once a coder had completed that process, he or she then turned to the other sources. As new information was found, this was also coded and the source duly noted. Whenever ambiguities or contradictions arose, the source providing the most detailed, clearly documented evidence was used. After two coders had separately completed the coding instrument for a particular country, their scores were compared by a research associate. Areas of discrepancy were discussed at length with the coders and were reconciled in order to arrive at a single score on each question for each country. The data for each country were then combined into a master file, and the answers and substantiating evidence were entered into a database. The coding procedures used in the latest report varied somewhat from previous years because of the relatively late release of the U.S. State Department’s International Religious Freedom report, which was made public in July 2014. Prior to the release of the State Department report, Pew Research coders completed the coding procedure for each country using all other available sources. After the State Department released the International Religious Freedom report, the coders went back over each country and updated their coding as necessary. After data collection for all countries was completed, Pew Research coders and researchers compared the scores from calendar year 2013 with those from the previous year, ending Dec. 31, 2012. They identified scores that had changed and analyzed the substantiating evidence for each year to make sure the change was substantive and not the result of coder error. Throughout this process, the coding instrument itself was continually monitored for possible defects. The questions were designed to be precise, comprehensive and objective so that, based on the same data and definitions, the coding could be reliably reproduced by others with the same results. At the same time, the Pew Research Center has attempted to minimize changes to the coding instrument as much as is possible to ensure all changes between years are the result of actual changes in restrictions and hostilities, not changes in methodology. Pew Research staff generally found few cases in which one source contradicted another. When contradictions did arise – such as when sources provided differing estimates of the number of people displaced due to religion-related violence – the source that cited the most specific documentation was used. The coders were instructed to disregard broad, unsubstantiated generalizations regarding abuses and to focus on reports that contained clear, precise documentation and factual details, such as names, dates and places where incidents occurred. Pew Research staff compared coders’ scores for all questions for each of the 198 countries and territories included in the study, computing the degree to which the scores matched. The inter-rater reliability score across all variables was 0.74. Scores above 0.7 are generally considered good. The data-verification procedures went beyond the inter-rater reliability statistics. They also involved comparing the answers on the main measures for each country with other closely related questions in the data set. This provided a practical way to test the internal reliability of the data. In previous years, Pew Research staff also checked the reliability of the coded data by comparing them with similar, though more limited, religious restrictions data sets. In particular, published government and social regulation of religion index scores are available from the Association of Religion Data Archives (for three years of data) and the Hudson Institute (for one year of data), which makes them ideal measures for cross-validation. The review process found very few significant discrepancies in the coded data; changes were made only if warranted by a further review of the primary sources.

Restriction of Religion Indexeshis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions 2. U.S. State Department annual reports on International Religious Freedom 3. U.S. Commission on International Religious Freedom annual reports 4. U.N. Special Rapporteur on Freedom of Religion or Belief reports 5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding 6. Human Rights Watch topical reports 7. International Crisis Group country reports 8. United Kingdom Foreign & Commonwealth Office annual report on human rights 9. Council of the European Union annual report on human rights 10. Global Terrorism Database 11. European Network Against Racism Shadow Reports 12. United Nations High Commissioner for Refugees reports 13. U.S. State Department annual Country Reports on Terrorism 14. Anti-Defamation League reports 15. U.S. State Department Country Reports on Human Rights Practices 16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database 17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters U.S. government reports with information on the situation in the United States • U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports • FBI Hate Crime Reports One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study. As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database. The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world. In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available. While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrument

As explained in more detail below, Pew Research staff developed a battery of questions similar to a survey questionnaire. Coders consulted the primary sources in order to answer the questions separately for each country. While the State Department’s annual reports on International Religious Freedom generally contained the most comprehensive information, the other sources provided additional factual detail that was used to settle ambiguities, resolve contradictions and help in the proper scoring of each question. The questionnaire, or coding instrument, generated a set of numerical measures on restrictions in each country. It also made it possible to see how government restrictions intersect with broader social tensions and incidents of violence or intimidation by private actors. The coding instrument with the list of questions used for this report is shown in the Summary of Results starting on page 64. The coding process required the coders to check all the sources for each country. Coders determined whether each source provided information critical to assigning a score; had supporting information but did not result in new facts; or had no available information on that particular country. Multiple sources of information were available for all countries and self-administering territories with populations greater than 1 million. Most of the countries and territories analyzed by the Pew Research Center were multi-sourced; only small, predominantly island, countries had a single source, namely, the State Department reports. Coding the United States presented a special problem since it is not included in the State Department’s annual reports on International Religious Freedom. Accordingly, Pew Research coders also looked at reports from the U.S. Department of Justice and the FBI on violations of religious freedom in the United States, in addition to consulting all the primary sources, including reports by the United Nations, Human Rights Watch, Freedom House, the International Crisis Group and the U.K. Foreign & Commonwealth Office, many of which contain data on the United States.

The Coding Process

The Pew Research Center employed strict training and rigorous coding protocols to make its coding as objective and reproducible as possible. Coders worked directly under an experienced researcher’s supervision, with additional direction and support provided by other Pew Research Center researchers. The coders underwent an intensive training period that included a thorough overview of the research objectives, information sources and Methodology. Countries were double-blind coded by two coders (coders did not see each other’s ratings), and the initial ratings were entered into an electronic document (coding instrument) including details on each incident. The coders began by filling out the coding instrument for each country using the information source that had the most comprehensive information. The protocol for each coder was to answer every question on which information was available in the initial source. Once a coder had completed that process, he or she then turned to the other sources. As new information was found, this was also coded and the source duly noted. Whenever ambiguities or contradictions arose, the source providing the most detailed, clearly documented evidence was used. After two coders had separately completed the coding instrument for a particular country, their scores were compared by a research associate. Areas of discrepancy were discussed at length with the coders and were reconciled in order to arrive at a single score on each question for each country. The data for each country were then combined into a master file, and the answers and substantiating evidence were entered into a database. The coding procedures used in the latest report varied somewhat from previous years because of the relatively late release of the U.S. State Department’s International Religious Freedom report, which was made public in July 2014. Prior to the release of the State Department report, Pew Research coders completed the coding procedure for each country using all other available sources. After the State Department released the International Religious Freedom report, the coders went back over each country and updated their coding as necessary. After data collection for all countries was completed, Pew Research coders and researchers compared the scores from calendar year 2013 with those from the previous year, ending Dec. 31, 2012. They identified scores that had changed and analyzed the substantiating evidence for each year to make sure the change was substantive and not the result of coder error. Throughout this process, the coding instrument itself was continually monitored for possible defects. The questions were designed to be precise, comprehensive and objective so that, based on the same data and definitions, the coding could be reliably reproduced by others with the same results. At the same time, the Pew Research Center has attempted to minimize changes to the coding instrument as much as is possible to ensure all changes between years are the result of actual changes in restrictions and hostilities, not changes in methodology. Pew Research staff generally found few cases in which one source contradicted another. When contradictions did arise – such as when sources provided differing estimates of the number of people displaced due to religion-related violence – the source that cited the most specific documentation was used. The coders were instructed to disregard broad, unsubstantiated generalizations regarding abuses and to focus on reports that contained clear, precise documentation and factual details, such as names, dates and places where incidents occurred. Pew Research staff compared coders’ scores for all questions for each of the 198 countries and territories included in the study, computing the degree to which the scores matched. The inter-rater reliability score across all variables was 0.74. Scores above 0.7 are generally considered good. The data-verification procedures went beyond the inter-rater reliability statistics. They also involved comparing the answers on the main measures for each country with other closely related questions in the data set. This provided a practical way to test the internal reliability of the data. In previous years, Pew Research staff also checked the reliability of the coded data by comparing them with similar, though more limited, religious restrictions data sets. In particular, published government and social regulation of religion index scores are available from the Association of Religion Data Archives (for three years of data) and the Hudson Institute (for one year of data), which makes them ideal measures for cross-validation. The review process found very few significant discrepancies in the coded data; changes were made only if warranted by a further review of the primary sources.

Restriction of Religion Indexes

The Government Restrictions Index is based on 20 indicators of ways that national and local governments restrict religion, including through coercion and force. The Social Hostilities Index is based on 13 indicators of ways in which private individuals and social groups infringe on religious beliefs and practices, including religiously biased crimes, mob violence and efforts to stop particular religious groups from growing or operating. The study also counted the number and types of documented incidents of religion-related violence, including terrorism and armed conflict.

Government Restrictions Index

Coding multiple indicators makes it possible to construct a Government Restrictions Index of sufficient gradation to allow for meaningful cross-national comparisons. An additional advantage of using multiple indicators is that it helps mitigate the effects of measurement error in any one variable, providing greater confidence in the overall measure. The Pew Research Center coded 20 indicators of government restrictions on religion (see the Summary of Results). These 20 items were added together to create the GRI. In two cases, these items represent an aggregation of several closely related questions: Measures of five types of physical abuses are combined into a single variable (GRI Q.19), and seven questions measuring aspects of government favoritism are combined into an overall favoritism scale. (GRI Q.20 is a summary variable showing whether a country received the maximum score on one or more of the seven questions.) The GRI is a fine-grained measure created by adding the 20 items on a 0-to-10 metric, with zero indicating very low levels of government restrictions on religion and 10 indicating very high levels of restrictions. The 20 questions that form the GRI are coded in a standard scale from zero to one point, while gradations among the answers allowed for partial points to be given for lesser degrees of the particular government restriction being measured. The overall value of the index was calculated and proportionally adjusted – so that it had a maximum value of 10 and a possible range of zero to 10 – by dividing the sum of the variables by two. A test of whether the 20 items were statistically reliable as a single index produced a scale reliability coefficient of 0.91 for calendar year 2013. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these 20 items into a single index.

Social Hostilities Index

In addition to government restrictions, violence and intimidation in societies also can limit religious beliefs and practices. Accordingly, Pew Research staff tracked more than a dozen indicators of social impediments on religion. Once again, coding multiple indicators made it possible to construct an index that shows gradations of severity or intensity and allows for comparisons among countries. The Summary of Results contains the 13 items used by Pew Research staff to create the Social Hostilities Index. The SHI was constructed by adding together the 13 indicators based on a 0-to-10 metric, with zero indicating very low impediments to religious beliefs and practices and 10 indicating very high impediments. The various questions that form the index are coded in a standard scale from zero to one point, while gradations among the answers allow for partial points to be given for lesser degrees of the particular hostilities being measured. The indicators were added together and set to have a possible range of zero to 10 by dividing the sum of the variables by 1.3. As with the Government Restrictions Index, various types of violence and intimidation were combined. A test of whether these 13 items were statistically reliable as a single index produced a scale reliability coefficient of 0.89. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these items into a single index.

How Examples Are Coded

Examples of each type of government restriction or social hostility are generally counted in a single measure on the GRI or SHI. For instance, a restriction on proselytizing (sharing one’s faith with the intent of persuading another to join the faith) is not also counted as a restriction on conversion (an individual changing his/her religion). In some situations, however, an individual restriction or hostility may be part of a broader set of restrictions or hostilities. For instance, a mob attack by members of one religious group on an individual of another religion may be an isolated event and counted just under question SHI Q.2: Was there mob violence related to religion? (See the Summary of Results.) However, if such an attack triggers repeated attacks between religious groups, it also might be an indication of sectarian or communal violence, which by definition involves two or more religious groups facing off in repeated clashes. In such a case, the mob attack also would be counted under question SHI Q.3: Were there acts of sectarian or communal violence between religious groups? (See the Summary of Results.)

Effects of Consolidating to a New Database

For the first few years of this study, information on the number, types and locations of incidents of government force and social violence toward religious groups as well as deference to religious authorities in matters of law were coded at the province level. (See example of data coding on pages 45-48 of the December 2009 baseline report.) Each year, the province numbers were summed and put into separate country-level files. Following the publication of the August 2011 report, Pew Research staff created a database that integrated all province- and country-level data on religious restrictions. During this process, Pew Research staff reviewed any discrepancies between province files and the sums that had been transferred to the country files and made appropriate corrections. The adjustments made were relatively minor and had small effects on index scores for countries, on average less than 0.005 points on the 10-point indexes. Consolidating the data into a database also entailed a review of the data on harassment of religious groups. In particular, instances of harassment from the year ending in mid-2007 were stored as open-ended questions, and in a few cases they were recoded to match the categories used in subsequent years. Beginning in 2013, Pew Research stopped collecting data at the province-level; all data is coded at the country level.

Changing Time Period of Analysis

This is the third time Pew Research has analyzed restrictions on religion in a calendar year. Previous reports analyzed 12-month periods from July 1-June 30 (e.g., July 1, 2009-June 30, 2010). The shift to calendar years was made, in part, because most of the primary sources used in this study are based on calendar years. Because of the shift in time frame, previous studies did not report directly on incidents that occurred during the period from July 1-Dec. 31, 2010. While this misses some incidents that occurred during the second half of 2010, events that had an ongoing impact – such as a change to a country’s constitution or the outbreak of a religion-related war – were captured by the coding. Researchers for the study carefully reviewed the situation in each country and territory during this six-month period and made sure that restrictions with an ongoing impact were not overlooked.

Religion-Related Terrorism and Armed Conflict

Terrorism and war can have huge direct and indirect effects on religious groups, including destroying religious sites, displacing whole communities and inflaming sectarian passions. Accordingly, Pew Research tallied the number, location and consequences of religion-related terrorism and armed conflict around the world, as reported in the same primary sources used to document other forms of intimidation and violence. However, war and terrorism are sufficiently complex that it is not always possible to determine the degree to which they are religiously motivated or state sponsored. Out of an abundance of caution, this study does not include them in the Government Restrictions Index. They are factored instead into the index of social hostilities involving religion, which includes one question specifically about religion-related terrorism and one question specifically about religion-related war or armed conflict. In addition, other measures in both indexes are likely to pick up spillover effects of war and terrorism on the level of religious tensions in society. For example, hate crimes, mob violence and sectarian fighting that occur in the aftermath of a terrorist attack or in the context of a religion-related war would be counted in the Social Hostilities Index, and laws or policies that clearly discriminate against a particular religious group would be registered on the Government Restrictions Index. For the purposes of this study, the term “religion-related terrorism” is defined as premeditated, politically motivated violence perpetrated against noncombatant affects by subnational groups or clandestine agents that have some identifiable religious ideology or religious motivation. It also includes acts carried out by groups that have a nonreligious identity but affect religious personnel, such as clergy. Readers should note that it is the political character and motivation of the groups, not the type of violence, that is at issue here. For instance, a bombing would not be classified as religion-related terrorism if there was no clearly discernible religious ideology or bias behind it unless it was directed at religious personnel. Religion-related war or armed conflict is defined as armed conflict (a conflict that involves sustained casualties over time or more than 1,000 battle deaths) in which religious rhetoric is commonly used to justify the use of force, or in which one or more of the combatants primarily identifies itself or the opposing side by religion.

Changes to Somalia’s Coding

In the latest year studied, researchers changed the way they coded government restrictions in Somalia. In previous years of the study, researchers had coded actions by the al-Shabaab rebel group as government restrictions, largely because the group effectively controlled large swathes of Somali territory. The extent of al-Shabaab control over Somali territory decreased in calendar year 2013, so researchers did not code their actions as government restrictions but rather as social hostilities. This contributed to the drop in Somalia’s GRI score, even though actual practices by the government did not change appreciably.

Potential Biaseshis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions 2. U.S. State Department annual reports on International Religious Freedom 3. U.S. Commission on International Religious Freedom annual reports 4. U.N. Special Rapporteur on Freedom of Religion or Belief reports 5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding 6. Human Rights Watch topical reports 7. International Crisis Group country reports 8. United Kingdom Foreign & Commonwealth Office annual report on human rights 9. Council of the European Union annual report on human rights 10. Global Terrorism Database 11. European Network Against Racism Shadow Reports 12. United Nations High Commissioner for Refugees reports 13. U.S. State Department annual Country Reports on Terrorism 14. Anti-Defamation League reports 15. U.S. State Department Country Reports on Human Rights Practices 16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database 17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters U.S. government reports with information on the situation in the United States • U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports • FBI Hate Crime Reports One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study. As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database. The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world. In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available. While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrument

As explained in more detail below, Pew Research staff developed a battery of questions similar to a survey questionnaire. Coders consulted the primary sources in order to answer the questions separately for each country. While the State Department’s annual reports on International Religious Freedom generally contained the most comprehensive information, the other sources provided additional factual detail that was used to settle ambiguities, resolve contradictions and help in the proper scoring of each question. The questionnaire, or coding instrument, generated a set of numerical measures on restrictions in each country. It also made it possible to see how government restrictions intersect with broader social tensions and incidents of violence or intimidation by private actors. The coding instrument with the list of questions used for this report is shown in the Summary of Results starting on page 64. The coding process required the coders to check all the sources for each country. Coders determined whether each source provided information critical to assigning a score; had supporting information but did not result in new facts; or had no available information on that particular country. Multiple sources of information were available for all countries and self-administering territories with populations greater than 1 million. Most of the countries and territories analyzed by the Pew Research Center were multi-sourced; only small, predominantly island, countries had a single source, namely, the State Department reports. Coding the United States presented a special problem since it is not included in the State Department’s annual reports on International Religious Freedom. Accordingly, Pew Research coders also looked at reports from the U.S. Department of Justice and the FBI on violations of religious freedom in the United States, in addition to consulting all the primary sources, including reports by the United Nations, Human Rights Watch, Freedom House, the International Crisis Group and the U.K. Foreign & Commonwealth Office, many of which contain data on the United States.

The Coding Process

The Pew Research Center employed strict training and rigorous coding protocols to make its coding as objective and reproducible as possible. Coders worked directly under an experienced researcher’s supervision, with additional direction and support provided by other Pew Research Center researchers. The coders underwent an intensive training period that included a thorough overview of the research objectives, information sources and Methodology. Countries were double-blind coded by two coders (coders did not see each other’s ratings), and the initial ratings were entered into an electronic document (coding instrument) including details on each incident. The coders began by filling out the coding instrument for each country using the information source that had the most comprehensive information. The protocol for each coder was to answer every question on which information was available in the initial source. Once a coder had completed that process, he or she then turned to the other sources. As new information was found, this was also coded and the source duly noted. Whenever ambiguities or contradictions arose, the source providing the most detailed, clearly documented evidence was used. After two coders had separately completed the coding instrument for a particular country, their scores were compared by a research associate. Areas of discrepancy were discussed at length with the coders and were reconciled in order to arrive at a single score on each question for each country. The data for each country were then combined into a master file, and the answers and substantiating evidence were entered into a database. The coding procedures used in the latest report varied somewhat from previous years because of the relatively late release of the U.S. State Department’s International Religious Freedom report, which was made public in July 2014. Prior to the release of the State Department report, Pew Research coders completed the coding procedure for each country using all other available sources. After the State Department released the International Religious Freedom report, the coders went back over each country and updated their coding as necessary. After data collection for all countries was completed, Pew Research coders and researchers compared the scores from calendar year 2013 with those from the previous year, ending Dec. 31, 2012. They identified scores that had changed and analyzed the substantiating evidence for each year to make sure the change was substantive and not the result of coder error. Throughout this process, the coding instrument itself was continually monitored for possible defects. The questions were designed to be precise, comprehensive and objective so that, based on the same data and definitions, the coding could be reliably reproduced by others with the same results. At the same time, the Pew Research Center has attempted to minimize changes to the coding instrument as much as is possible to ensure all changes between years are the result of actual changes in restrictions and hostilities, not changes in methodology. Pew Research staff generally found few cases in which one source contradicted another. When contradictions did arise – such as when sources provided differing estimates of the number of people displaced due to religion-related violence – the source that cited the most specific documentation was used. The coders were instructed to disregard broad, unsubstantiated generalizations regarding abuses and to focus on reports that contained clear, precise documentation and factual details, such as names, dates and places where incidents occurred. Pew Research staff compared coders’ scores for all questions for each of the 198 countries and territories included in the study, computing the degree to which the scores matched. The inter-rater reliability score across all variables was 0.74. Scores above 0.7 are generally considered good. The data-verification procedures went beyond the inter-rater reliability statistics. They also involved comparing the answers on the main measures for each country with other closely related questions in the data set. This provided a practical way to test the internal reliability of the data. In previous years, Pew Research staff also checked the reliability of the coded data by comparing them with similar, though more limited, religious restrictions data sets. In particular, published government and social regulation of religion index scores are available from the Association of Religion Data Archives (for three years of data) and the Hudson Institute (for one year of data), which makes them ideal measures for cross-validation. The review process found very few significant discrepancies in the coded data; changes were made only if warranted by a further review of the primary sources.

Restriction of Religion Indexes

The Government Restrictions Index is based on 20 indicators of ways that national and local governments restrict religion, including through coercion and force. The Social Hostilities Index is based on 13 indicators of ways in which private individuals and social groups infringe on religious beliefs and practices, including religiously biased crimes, mob violence and efforts to stop particular religious groups from growing or operating. The study also counted the number and types of documented incidents of religion-related violence, including terrorism and armed conflict.

Government Restrictions Index

Coding multiple indicators makes it possible to construct a Government Restrictions Index of sufficient gradation to allow for meaningful cross-national comparisons. An additional advantage of using multiple indicators is that it helps mitigate the effects of measurement error in any one variable, providing greater confidence in the overall measure. The Pew Research Center coded 20 indicators of government restrictions on religion (see the Summary of Results). These 20 items were added together to create the GRI. In two cases, these items represent an aggregation of several closely related questions: Measures of five types of physical abuses are combined into a single variable (GRI Q.19), and seven questions measuring aspects of government favoritism are combined into an overall favoritism scale. (GRI Q.20 is a summary variable showing whether a country received the maximum score on one or more of the seven questions.) The GRI is a fine-grained measure created by adding the 20 items on a 0-to-10 metric, with zero indicating very low levels of government restrictions on religion and 10 indicating very high levels of restrictions. The 20 questions that form the GRI are coded in a standard scale from zero to one point, while gradations among the answers allowed for partial points to be given for lesser degrees of the particular government restriction being measured. The overall value of the index was calculated and proportionally adjusted – so that it had a maximum value of 10 and a possible range of zero to 10 – by dividing the sum of the variables by two. A test of whether the 20 items were statistically reliable as a single index produced a scale reliability coefficient of 0.91 for calendar year 2013. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these 20 items into a single index.

Social Hostilities Index

In addition to government restrictions, violence and intimidation in societies also can limit religious beliefs and practices. Accordingly, Pew Research staff tracked more than a dozen indicators of social impediments on religion. Once again, coding multiple indicators made it possible to construct an index that shows gradations of severity or intensity and allows for comparisons among countries. The Summary of Results contains the 13 items used by Pew Research staff to create the Social Hostilities Index. The SHI was constructed by adding together the 13 indicators based on a 0-to-10 metric, with zero indicating very low impediments to religious beliefs and practices and 10 indicating very high impediments. The various questions that form the index are coded in a standard scale from zero to one point, while gradations among the answers allow for partial points to be given for lesser degrees of the particular hostilities being measured. The indicators were added together and set to have a possible range of zero to 10 by dividing the sum of the variables by 1.3. As with the Government Restrictions Index, various types of violence and intimidation were combined. A test of whether these 13 items were statistically reliable as a single index produced a scale reliability coefficient of 0.89. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these items into a single index.

How Examples Are Coded

Examples of each type of government restriction or social hostility are generally counted in a single measure on the GRI or SHI. For instance, a restriction on proselytizing (sharing one’s faith with the intent of persuading another to join the faith) is not also counted as a restriction on conversion (an individual changing his/her religion). In some situations, however, an individual restriction or hostility may be part of a broader set of restrictions or hostilities. For instance, a mob attack by members of one religious group on an individual of another religion may be an isolated event and counted just under question SHI Q.2: Was there mob violence related to religion? (See the Summary of Results.) However, if such an attack triggers repeated attacks between religious groups, it also might be an indication of sectarian or communal violence, which by definition involves two or more religious groups facing off in repeated clashes. In such a case, the mob attack also would be counted under question SHI Q.3: Were there acts of sectarian or communal violence between religious groups? (See the Summary of Results.)

Effects of Consolidating to a New Database

For the first few years of this study, information on the number, types and locations of incidents of government force and social violence toward religious groups as well as deference to religious authorities in matters of law were coded at the province level. (See example of data coding on pages 45-48 of the December 2009 baseline report.) Each year, the province numbers were summed and put into separate country-level files. Following the publication of the August 2011 report, Pew Research staff created a database that integrated all province- and country-level data on religious restrictions. During this process, Pew Research staff reviewed any discrepancies between province files and the sums that had been transferred to the country files and made appropriate corrections. The adjustments made were relatively minor and had small effects on index scores for countries, on average less than 0.005 points on the 10-point indexes. Consolidating the data into a database also entailed a review of the data on harassment of religious groups. In particular, instances of harassment from the year ending in mid-2007 were stored as open-ended questions, and in a few cases they were recoded to match the categories used in subsequent years. Beginning in 2013, Pew Research stopped collecting data at the province-level; all data is coded at the country level.

Changing Time Period of Analysis

This is the third time Pew Research has analyzed restrictions on religion in a calendar year. Previous reports analyzed 12-month periods from July 1-June 30 (e.g., July 1, 2009-June 30, 2010). The shift to calendar years was made, in part, because most of the primary sources used in this study are based on calendar years. Because of the shift in time frame, previous studies did not report directly on incidents that occurred during the period from July 1-Dec. 31, 2010. While this misses some incidents that occurred during the second half of 2010, events that had an ongoing impact – such as a change to a country’s constitution or the outbreak of a religion-related war – were captured by the coding. Researchers for the study carefully reviewed the situation in each country and territory during this six-month period and made sure that restrictions with an ongoing impact were not overlooked.

Religion-Related Terrorism and Armed Conflict

Terrorism and war can have huge direct and indirect effects on religious groups, including destroying religious sites, displacing whole communities and inflaming sectarian passions. Accordingly, Pew Research tallied the number, location and consequences of religion-related terrorism and armed conflict around the world, as reported in the same primary sources used to document other forms of intimidation and violence. However, war and terrorism are sufficiently complex that it is not always possible to determine the degree to which they are religiously motivated or state sponsored. Out of an abundance of caution, this study does not include them in the Government Restrictions Index. They are factored instead into the index of social hostilities involving religion, which includes one question specifically about religion-related terrorism and one question specifically about religion-related war or armed conflict. In addition, other measures in both indexes are likely to pick up spillover effects of war and terrorism on the level of religious tensions in society. For example, hate crimes, mob violence and sectarian fighting that occur in the aftermath of a terrorist attack or in the context of a religion-related war would be counted in the Social Hostilities Index, and laws or policies that clearly discriminate against a particular religious group would be registered on the Government Restrictions Index. For the purposes of this study, the term “religion-related terrorism” is defined as premeditated, politically motivated violence perpetrated against noncombatant affects by subnational groups or clandestine agents that have some identifiable religious ideology or religious motivation. It also includes acts carried out by groups that have a nonreligious identity but affect religious personnel, such as clergy. Readers should note that it is the political character and motivation of the groups, not the type of violence, that is at issue here. For instance, a bombing would not be classified as religion-related terrorism if there was no clearly discernible religious ideology or bias behind it unless it was directed at religious personnel. Religion-related war or armed conflict is defined as armed conflict (a conflict that involves sustained casualties over time or more than 1,000 battle deaths) in which religious rhetoric is commonly used to justify the use of force, or in which one or more of the combatants primarily identifies itself or the opposing side by religion.

Changes to Somalia’s Coding

In the latest year studied, researchers changed the way they coded government restrictions in Somalia. In previous years of the study, researchers had coded actions by the al-Shabaab rebel group as government restrictions, largely because the group effectively controlled large swathes of Somali territory. The extent of al-Shabaab control over Somali territory decreased in calendar year 2013, so researchers did not code their actions as government restrictions but rather as social hostilities. This contributed to the drop in Somalia’s GRI score, even though actual practices by the government did not change appreciably.

Potential Biases

As noted earlier, the primary sources indicate that the North Korean government is among the most repressive in the world, including toward religion. But because independent observers lack regular access to North Korea, the sources are unable to provide the kind of specific, timely information that forms the basis of this report. Therefore, North Korea is not included on either index. This raises two important issues concerning potential information bias in the sources. The first is whether other countries that limit outsiders’ access and that may seek to obscure or distort their record on religious restrictions were adequately covered by the sources. Countries with relatively limited access have multiple primary sources of information that the Pew Research Center used for its coding. Each is also covered by other secondary quantitative data sets on religious restrictions that have used a similar coding scheme, including earlier years of coded State Department report data produced by Grim at Penn State’s Association of Religion Data Archives (ARDA) project (four data sets); independent coding by experts at the Hudson Institute’s Center for Religious Liberty using indexes also available from ARDA (one data set); and content analysis of country constitutions conducted by the Becket Fund for Religious Liberty (one data set). Pew Research staff used these for cross-validation. Thus, contrary to what one might expect, even most countries that limit access to information tend to receive fairly extensive coverage by groups that monitor religious restrictions. The second key question – the flipside of the first – is whether countries that provide freer access to information receive worse scores simply because more information is available on them. As described more fully in the methodology in the baseline report, Pew Research staff compared the length of State Department reports on freer-access countries with those of less-free-access countries. The comparison found that the median number of words was approximately three times as large for the limited-access countries as for the open-access countries. This suggests that problems in freer-access countries are generally not overreported in the State Department reports. Only when it comes to religion-related violence and intimidation in society do the sources report more problems in the freer-access countries than in the limited-access ones. However, the Social Hostilities Index includes several measures – such as SHI Q.8 (“Did religious groups themselves attempt to prevent other religious groups from being able to operate?”) and SHI Q.11 (“Were women harassed for violating religious dress codes?”) – that are less susceptible to such reporting bias because they capture general social trends or attitudes as well as specific incidents. With these limitations in mind, it appears that the coded information on social hostilities is a fair gauge of the situation in the vast majority of countries and a valuable complement to the information on government restrictions. Data on social impediments to religious practice can more confidently be used to make comparisons among countries with sufficient openness, which includes more than nine-in-ten countries covered in the coding. An analysis by Grim and Richard Wike, the Pew Research Center’s director of global attitudes research, tested the reliability of the State Department reports on social impediments to religious practice by comparing public opinion data with data coded from the reports in previous years by Grim and experts at Penn State. They concluded that “the understanding of social religious intolerance embodied in the State Department reports is comparable with the results of population surveys and individual expert opinion.”[5. See Grim, Brian J. and Richard Wike. 2010. “Cross-Validating Measures of Global Religious Intolerance: Comparing Coded State De- partment Reports with Survey Data and Expert Opinion.” Politics and Religion, vol. 3, issue 1: 102-129.]

Coding Harassment of Specific Religious Groupshis is the sixth time the Pew Research Center has measured restrictions on religion around the globe.[1. numoffset="44" See Methodology of the Pew Research Center’s 2009 report, “Global Restrictions on Religion,” for a discussion of the conceptual basis for measuring restrictions on religion.] This report, which includes data for the year ending Dec. 31, 2013, generally follows the same methodology as previous reports, although it includes one new analysis, which is discussed below. Pew Research uses two 10-point indexes – the Government Restrictions Index (GRI) and the Social Hostilities Index (SHI) – to rate 198 countries and self-governing territories on their levels of restrictions.[2. Some earlier reports provided scores for 197 countries and territories. This report includes South Sudan (which separated from Sudan in July 2011), bringing the total to 198 countries and territories.] This report analyzes changes in restrictions on an annual basis, focusing on the period from 2012 to 2013. The study categorizes the amount of change in each country’s scores in two ways, numerically and by percentile. First, countries are grouped into categories depending on the size of the numeric change in their scores from year to year on the two indexes: changes of two points or more in either direction; changes of at least one point but less than two points; changes of less than one point; or no change at all. (See chart at right.) Changes in overall levels of restrictions are calculated for each country by comparing its scores on both indexes (the GRI and the SHI) from year to year. When a country’s scores on the GRI and the SHI changed in the same direction (both increased or both decreased), the greater amount of change determined the category. For instance, if the country’s GRI score increased by 0.8 and its SHI score increased by 1.5, the country was put into the overall “1.0 to 1.9 increase” category. When a country’s score increased on one index but decreased on the other, the difference between the amounts of change determined the grouping. For example, if the country’s GRI score increased by 2.0 and its SHI score decreased by 1.5, the country went into the overall “0.1 to 0.9 increase” category. When a country’s score on one index stayed the same, the amount of change on the other index was used to assign the category. Second, this report categorizes the levels of government restrictions and social hostilities in each country by percentiles. As the benchmark, it uses the results from the baseline year of the study (the year ending in mid-2007). Scores in the top 5% on each index in mid-2007 were categorized as “very high.” The next highest 15% of scores were categorized as “high,” and the following 20% were categorized as “moderate.” The bottom 60% of scores were categorized as “low.” See the table to the right for the index score thresholds as determined from the mid-2007 data. These thresholds are applied to all subsequent years of data.

Overview of Procedures

The methodology used by Pew Research to assess and compare restrictions on religion was developed by former Pew Research senior researcher and director of cross-national data Brian J. Grim in consultation with other members of the Pew Research Center staff, building on a methodology that Grim and Professor Roger Finke developed while at Penn State University’s Association of Religion Data Archives.[3. See Grim, Brian J. and Roger Finke. 2006. “International Religion Indexes: Government Regulation, Government Favoritism, and Social Regulation of Religion.” Interdisciplinary Journal of Research on Religion, vol. 2, article 1.] The goal was to devise quantifiable, objective and transparent measures of the extent to which governments and societal groups impinge on the practice of religion. The findings were used to rate countries and self-governing territories on two indexes that are reproducible and can be periodically updated. This research goes beyond previous efforts to assess restrictions on religion in several ways. First, Pew Research coded (categorized and counted) data from more than a dozen published cross-national sources, providing a high degree of confidence in the findings. The Pew Research coders looked to the sources for only specific, well-documented facts, not opinions or commentary. Second, Pew Research staff used extensive data-verification checks that reflect generally accepted best practices for such studies, such as double-blind coding (coders do not see each other’s ratings), inter-rater reliability assessments (checking for consistency among coders) and carefully monitored protocols to reconcile discrepancies among coders. Third, the Pew Research coding took into account whether the perpetrators of religion-related violence were government or private actors. The coding also identified how widespread and intensive the restrictions were in each country. Fourth, one of the most valuable contributions of the indexes and the questions used to construct them (see the section on “The Coding Instrument” on page 37) is their ability to chart change over time.

Countries and Territories

The 198 countries and self-administering territories covered by the study contain more than 99.5% of the world’s population. They include 192 of the 193 member states of the United Nations as of 2013 plus six self-administering territories – Kosovo, Hong Kong, Macau, the Palestinian territories, Taiwan and Western Sahara.[4. The one member state of the United Nations not included in the study is North Korea. The sources clearly indicate that North Korea’s government is among the most repressive in the world with respect to religion as well as other civil and political liberties. (The U.S. State Department’s 2013 Report on International Religious Freedom, for example, says that “Genuine freedom of religion does not exist” in North Korea.) But because North Korean society is effectively closed to outsiders and independent observers lack regular access to the country, the sources were unable to provide the kind of specific, timely information that the Pew Research Center categorized and counted (“coded,” in social science parlance) for this quantitative study. Therefore, the report does not include scores for North Korea.] Reporting on these territories does not imply any position on what their international political status should be, only recognition that the de facto situations in these territories require separate analysis. Although the 198 countries and territories vary widely in size, population, wealth, ethnic diversity, religious makeup and form of government, the study does not attempt to adjust for such differences. Poor countries are not scored differently on the indexes than wealthy ones. Countries with diverse ethnic and religious populations are not “expected” to have more social hostilities than countries with more homogeneous populations. And democracies are not assessed more leniently or harshly than authoritarian regimes.

Information Sources

In the latest year of the study, Pew Research identified 17 widely available, frequently cited sources of information on government restrictions and social hostilities involving religion around the world. This study includes four sources that were not used in the baseline report on religious restrictions. The primary sources, which are listed below, include reports from U.S. government agencies, several independent, nongovernmental organizations and a variety of European and United Nations bodies. Although most of these organizations are based in Western countries, many of them depend on local staff to collect information across the globe. As previously noted, Pew Research did not use the commentaries, opinions or normative judgments of the sources; the sources were combed only for factual information on specific policies and actions.

Primary Sources for 2013

1. Country constitutions 2. U.S. State Department annual reports on International Religious Freedom 3. U.S. Commission on International Religious Freedom annual reports 4. U.N. Special Rapporteur on Freedom of Religion or Belief reports 5. Human Rights First reports in first and second years of coding; Freedom House reports in subsequent years of coding 6. Human Rights Watch topical reports 7. International Crisis Group country reports 8. United Kingdom Foreign & Commonwealth Office annual report on human rights 9. Council of the European Union annual report on human rights 10. Global Terrorism Database 11. European Network Against Racism Shadow Reports 12. United Nations High Commissioner for Refugees reports 13. U.S. State Department annual Country Reports on Terrorism 14. Anti-Defamation League reports 15. U.S. State Department Country Reports on Human Rights Practices 16. Uppsala University’s Uppsala Conflict Data Program, Armed Conflict Database 17. Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters U.S. government reports with information on the situation in the United States • U.S. Department of Justice “Religious Freedom in Focus” newsletters and reports • FBI Hate Crime Reports One source used in the previous report – Amnesty International’s Country Reports – was not available for the latest round of coding. But information provided in previous Amnesty International reports, including data on religion-related detentions, was covered in other sources used in the study. As noted, this study includes four sources that were not included in the Pew Research Center’s first report on global restrictions on religion: Freedom House reports; Uppsala University’s Armed Conflict Database; the “Freedom of Religion or Belief” newsletters of Human Rights Without Frontiers; and the Global Terrorism Database. The Freedom House reports have replaced Human Rights First reports, which have not been updated since mid-2008. The Uppsala Armed Conflict Database provides information on the number of people affected by religion-related armed conflicts, supplementing other sources. The Human Rights Without Frontiers “Freedom of Religion or Belief” newsletters have replaced the Hudson Institute publication “Religious Freedom in the World” (by Paul Marshall), which has not been updated since its release in 2008. Human Rights Without Frontiers is a nongovernmental organization based in Brussels that has affiliated offices throughout the world. In the previous report, the Pew Research Center relied on three sources for information on religion-related terrorism: the International Crisis Group’s country reports, Uppsala University’s Armed Conflict Database and the State Department’s annual Country Reports on Terrorism. (One source used in earlier reports, the U.S. government’s Worldwide Incident Tracking System, is no longer available online.) In the latest year of coding, the Pew Research Center also used data from the Global Terrorism Database, maintained by the University of Maryland’s National Consortium for Terrorism and Responses to Terrorism. This database is one of the most comprehensive sources on terrorism around the world and is the source for the U.S. State Department’s Country Reports on Terrorism. The addition of this source thus provides greater context and information on terrorism without biasing the reporting through the addition of information that was not previously available. While some of the increases in religious restrictions noted in this study could reflect the use of more up-to-date and/or better information sources, Pew Research staff monitor the impact of source information variability each year and have found no evidence of overall informational bias. (For additional discussion, see the “Potential Biases” section in 2014’s report, “Religious Hostilities Reach Six-Year High.”)

The Coding Instrument

As explained in more detail below, Pew Research staff developed a battery of questions similar to a survey questionnaire. Coders consulted the primary sources in order to answer the questions separately for each country. While the State Department’s annual reports on International Religious Freedom generally contained the most comprehensive information, the other sources provided additional factual detail that was used to settle ambiguities, resolve contradictions and help in the proper scoring of each question. The questionnaire, or coding instrument, generated a set of numerical measures on restrictions in each country. It also made it possible to see how government restrictions intersect with broader social tensions and incidents of violence or intimidation by private actors. The coding instrument with the list of questions used for this report is shown in the Summary of Results starting on page 64. The coding process required the coders to check all the sources for each country. Coders determined whether each source provided information critical to assigning a score; had supporting information but did not result in new facts; or had no available information on that particular country. Multiple sources of information were available for all countries and self-administering territories with populations greater than 1 million. Most of the countries and territories analyzed by the Pew Research Center were multi-sourced; only small, predominantly island, countries had a single source, namely, the State Department reports. Coding the United States presented a special problem since it is not included in the State Department’s annual reports on International Religious Freedom. Accordingly, Pew Research coders also looked at reports from the U.S. Department of Justice and the FBI on violations of religious freedom in the United States, in addition to consulting all the primary sources, including reports by the United Nations, Human Rights Watch, Freedom House, the International Crisis Group and the U.K. Foreign & Commonwealth Office, many of which contain data on the United States.

The Coding Process

The Pew Research Center employed strict training and rigorous coding protocols to make its coding as objective and reproducible as possible. Coders worked directly under an experienced researcher’s supervision, with additional direction and support provided by other Pew Research Center researchers. The coders underwent an intensive training period that included a thorough overview of the research objectives, information sources and Methodology. Countries were double-blind coded by two coders (coders did not see each other’s ratings), and the initial ratings were entered into an electronic document (coding instrument) including details on each incident. The coders began by filling out the coding instrument for each country using the information source that had the most comprehensive information. The protocol for each coder was to answer every question on which information was available in the initial source. Once a coder had completed that process, he or she then turned to the other sources. As new information was found, this was also coded and the source duly noted. Whenever ambiguities or contradictions arose, the source providing the most detailed, clearly documented evidence was used. After two coders had separately completed the coding instrument for a particular country, their scores were compared by a research associate. Areas of discrepancy were discussed at length with the coders and were reconciled in order to arrive at a single score on each question for each country. The data for each country were then combined into a master file, and the answers and substantiating evidence were entered into a database. The coding procedures used in the latest report varied somewhat from previous years because of the relatively late release of the U.S. State Department’s International Religious Freedom report, which was made public in July 2014. Prior to the release of the State Department report, Pew Research coders completed the coding procedure for each country using all other available sources. After the State Department released the International Religious Freedom report, the coders went back over each country and updated their coding as necessary. After data collection for all countries was completed, Pew Research coders and researchers compared the scores from calendar year 2013 with those from the previous year, ending Dec. 31, 2012. They identified scores that had changed and analyzed the substantiating evidence for each year to make sure the change was substantive and not the result of coder error. Throughout this process, the coding instrument itself was continually monitored for possible defects. The questions were designed to be precise, comprehensive and objective so that, based on the same data and definitions, the coding could be reliably reproduced by others with the same results. At the same time, the Pew Research Center has attempted to minimize changes to the coding instrument as much as is possible to ensure all changes between years are the result of actual changes in restrictions and hostilities, not changes in methodology. Pew Research staff generally found few cases in which one source contradicted another. When contradictions did arise – such as when sources provided differing estimates of the number of people displaced due to religion-related violence – the source that cited the most specific documentation was used. The coders were instructed to disregard broad, unsubstantiated generalizations regarding abuses and to focus on reports that contained clear, precise documentation and factual details, such as names, dates and places where incidents occurred. Pew Research staff compared coders’ scores for all questions for each of the 198 countries and territories included in the study, computing the degree to which the scores matched. The inter-rater reliability score across all variables was 0.74. Scores above 0.7 are generally considered good. The data-verification procedures went beyond the inter-rater reliability statistics. They also involved comparing the answers on the main measures for each country with other closely related questions in the data set. This provided a practical way to test the internal reliability of the data. In previous years, Pew Research staff also checked the reliability of the coded data by comparing them with similar, though more limited, religious restrictions data sets. In particular, published government and social regulation of religion index scores are available from the Association of Religion Data Archives (for three years of data) and the Hudson Institute (for one year of data), which makes them ideal measures for cross-validation. The review process found very few significant discrepancies in the coded data; changes were made only if warranted by a further review of the primary sources.

Restriction of Religion Indexes

The Government Restrictions Index is based on 20 indicators of ways that national and local governments restrict religion, including through coercion and force. The Social Hostilities Index is based on 13 indicators of ways in which private individuals and social groups infringe on religious beliefs and practices, including religiously biased crimes, mob violence and efforts to stop particular religious groups from growing or operating. The study also counted the number and types of documented incidents of religion-related violence, including terrorism and armed conflict.

Government Restrictions Index

Coding multiple indicators makes it possible to construct a Government Restrictions Index of sufficient gradation to allow for meaningful cross-national comparisons. An additional advantage of using multiple indicators is that it helps mitigate the effects of measurement error in any one variable, providing greater confidence in the overall measure. The Pew Research Center coded 20 indicators of government restrictions on religion (see the Summary of Results). These 20 items were added together to create the GRI. In two cases, these items represent an aggregation of several closely related questions: Measures of five types of physical abuses are combined into a single variable (GRI Q.19), and seven questions measuring aspects of government favoritism are combined into an overall favoritism scale. (GRI Q.20 is a summary variable showing whether a country received the maximum score on one or more of the seven questions.) The GRI is a fine-grained measure created by adding the 20 items on a 0-to-10 metric, with zero indicating very low levels of government restrictions on religion and 10 indicating very high levels of restrictions. The 20 questions that form the GRI are coded in a standard scale from zero to one point, while gradations among the answers allowed for partial points to be given for lesser degrees of the particular government restriction being measured. The overall value of the index was calculated and proportionally adjusted – so that it had a maximum value of 10 and a possible range of zero to 10 – by dividing the sum of the variables by two. A test of whether the 20 items were statistically reliable as a single index produced a scale reliability coefficient of 0.91 for calendar year 2013. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these 20 items into a single index.

Social Hostilities Index

In addition to government restrictions, violence and intimidation in societies also can limit religious beliefs and practices. Accordingly, Pew Research staff tracked more than a dozen indicators of social impediments on religion. Once again, coding multiple indicators made it possible to construct an index that shows gradations of severity or intensity and allows for comparisons among countries. The Summary of Results contains the 13 items used by Pew Research staff to create the Social Hostilities Index. The SHI was constructed by adding together the 13 indicators based on a 0-to-10 metric, with zero indicating very low impediments to religious beliefs and practices and 10 indicating very high impediments. The various questions that form the index are coded in a standard scale from zero to one point, while gradations among the answers allow for partial points to be given for lesser degrees of the particular hostilities being measured. The indicators were added together and set to have a possible range of zero to 10 by dividing the sum of the variables by 1.3. As with the Government Restrictions Index, various types of violence and intimidation were combined. A test of whether these 13 items were statistically reliable as a single index produced a scale reliability coefficient of 0.89. Since coefficients of 0.7 or higher are generally considered acceptable, it was statistically appropriate to combine these items into a single index.

How Examples Are Coded

Examples of each type of government restriction or social hostility are generally counted in a single measure on the GRI or SHI. For instance, a restriction on proselytizing (sharing one’s faith with the intent of persuading another to join the faith) is not also counted as a restriction on conversion (an individual changing his/her religion). In some situations, however, an individual restriction or hostility may be part of a broader set of restrictions or hostilities. For instance, a mob attack by members of one religious group on an individual of another religion may be an isolated event and counted just under question SHI Q.2: Was there mob violence related to religion? (See the Summary of Results.) However, if such an attack triggers repeated attacks between religious groups, it also might be an indication of sectarian or communal violence, which by definition involves two or more religious groups facing off in repeated clashes. In such a case, the mob attack also would be counted under question SHI Q.3: Were there acts of sectarian or communal violence between religious groups? (See the Summary of Results.)

Effects of Consolidating to a New Database

For the first few years of this study, information on the number, types and locations of incidents of government force and social violence toward religious groups as well as deference to religious authorities in matters of law were coded at the province level. (See example of data coding on pages 45-48 of the December 2009 baseline report.) Each year, the province numbers were summed and put into separate country-level files. Following the publication of the August 2011 report, Pew Research staff created a database that integrated all province- and country-level data on religious restrictions. During this process, Pew Research staff reviewed any discrepancies between province files and the sums that had been transferred to the country files and made appropriate corrections. The adjustments made were relatively minor and had small effects on index scores for countries, on average less than 0.005 points on the 10-point indexes. Consolidating the data into a database also entailed a review of the data on harassment of religious groups. In particular, instances of harassment from the year ending in mid-2007 were stored as open-ended questions, and in a few cases they were recoded to match the categories used in subsequent years. Beginning in 2013, Pew Research stopped collecting data at the province-level; all data is coded at the country level.

Changing Time Period of Analysis

This is the third time Pew Research has analyzed restrictions on religion in a calendar year. Previous reports analyzed 12-month periods from July 1-June 30 (e.g., July 1, 2009-June 30, 2010). The shift to calendar years was made, in part, because most of the primary sources used in this study are based on calendar years. Because of the shift in time frame, previous studies did not report directly on incidents that occurred during the period from July 1-Dec. 31, 2010. While this misses some incidents that occurred during the second half of 2010, events that had an ongoing impact – such as a change to a country’s constitution or the outbreak of a religion-related war – were captured by the coding. Researchers for the study carefully reviewed the situation in each country and territory during this six-month period and made sure that restrictions with an ongoing impact were not overlooked.

Religion-Related Terrorism and Armed Conflict

Terrorism and war can have huge direct and indirect effects on religious groups, including destroying religious sites, displacing whole communities and inflaming sectarian passions. Accordingly, Pew Research tallied the number, location and consequences of religion-related terrorism and armed conflict around the world, as reported in the same primary sources used to document other forms of intimidation and violence. However, war and terrorism are sufficiently complex that it is not always possible to determine the degree to which they are religiously motivated or state sponsored. Out of an abundance of caution, this study does not include them in the Government Restrictions Index. They are factored instead into the index of social hostilities involving religion, which includes one question specifically about religion-related terrorism and one question specifically about religion-related war or armed conflict. In addition, other measures in both indexes are likely to pick up spillover effects of war and terrorism on the level of religious tensions in society. For example, hate crimes, mob violence and sectarian fighting that occur in the aftermath of a terrorist attack or in the context of a religion-related war would be counted in the Social Hostilities Index, and laws or policies that clearly discriminate against a particular religious group would be registered on the Government Restrictions Index. For the purposes of this study, the term “religion-related terrorism” is defined as premeditated, politically motivated violence perpetrated against noncombatant affects by subnational groups or clandestine agents that have some identifiable religious ideology or religious motivation. It also includes acts carried out by groups that have a nonreligious identity but affect religious personnel, such as clergy. Readers should note that it is the political character and motivation of the groups, not the type of violence, that is at issue here. For instance, a bombing would not be classified as religion-related terrorism if there was no clearly discernible religious ideology or bias behind it unless it was directed at religious personnel. Religion-related war or armed conflict is defined as armed conflict (a conflict that involves sustained casualties over time or more than 1,000 battle deaths) in which religious rhetoric is commonly used to justify the use of force, or in which one or more of the combatants primarily identifies itself or the opposing side by religion.

Changes to Somalia’s Coding

In the latest year studied, researchers changed the way they coded government restrictions in Somalia. In previous years of the study, researchers had coded actions by the al-Shabaab rebel group as government restrictions, largely because the group effectively controlled large swathes of Somali territory. The extent of al-Shabaab control over Somali territory decreased in calendar year 2013, so researchers did not code their actions as government restrictions but rather as social hostilities. This contributed to the drop in Somalia’s GRI score, even though actual practices by the government did not change appreciably.

Potential Biases

As noted earlier, the primary sources indicate that the North Korean government is among the most repressive in the world, including toward religion. But because independent observers lack regular access to North Korea, the sources are unable to provide the kind of specific, timely information that forms the basis of this report. Therefore, North Korea is not included on either index. This raises two important issues concerning potential information bias in the sources. The first is whether other countries that limit outsiders’ access and that may seek to obscure or distort their record on religious restrictions were adequately covered by the sources. Countries with relatively limited access have multiple primary sources of information that the Pew Research Center used for its coding. Each is also covered by other secondary quantitative data sets on religious restrictions that have used a similar coding scheme, including earlier years of coded State Department report data produced by Grim at Penn State’s Association of Religion Data Archives (ARDA) project (four data sets); independent coding by experts at the Hudson Institute’s Center for Religious Liberty using indexes also available from ARDA (one data set); and content analysis of country constitutions conducted by the Becket Fund for Religious Liberty (one data set). Pew Research staff used these for cross-validation. Thus, contrary to what one might expect, even most countries that limit access to information tend to receive fairly extensive coverage by groups that monitor religious restrictions. The second key question – the flipside of the first – is whether countries that provide freer access to information receive worse scores simply because more information is available on them. As described more fully in the methodology in the baseline report, Pew Research staff compared the length of State Department reports on freer-access countries with those of less-free-access countries. The comparison found that the median number of words was approximately three times as large for the limited-access countries as for the open-access countries. This suggests that problems in freer-access countries are generally not overreported in the State Department reports. Only when it comes to religion-related violence and intimidation in society do the sources report more problems in the freer-access countries than in the limited-access ones. However, the Social Hostilities Index includes several measures – such as SHI Q.8 (“Did religious groups themselves attempt to prevent other religious groups from being able to operate?”) and SHI Q.11 (“Were women harassed for violating religious dress codes?”) – that are less susceptible to such reporting bias because they capture general social trends or attitudes as well as specific incidents. With these limitations in mind, it appears that the coded information on social hostilities is a fair gauge of the situation in the vast majority of countries and a valuable complement to the information on government restrictions. Data on social impediments to religious practice can more confidently be used to make comparisons among countries with sufficient openness, which includes more than nine-in-ten countries covered in the coding. An analysis by Grim and Richard Wike, the Pew Research Center’s director of global attitudes research, tested the reliability of the State Department reports on social impediments to religious practice by comparing public opinion data with data coded from the reports in previous years by Grim and experts at Penn State. They concluded that “the understanding of social religious intolerance embodied in the State Department reports is comparable with the results of population surveys and individual expert opinion.”[5. See Grim, Brian J. and Richard Wike. 2010. “Cross-Validating Measures of Global Religious Intolerance: Comparing Coded State De- partment Reports with Survey Data and Expert Opinion.” Politics and Religion, vol. 3, issue 1: 102-129.]

Coding Harassment of Specific Religious Groups

As in previous reports, this study provides a summary of the number of countries where specific religious groups faced government or social harassment. This is essentially a cross-tabulation of GRI.Q.11 (“Was there harassment or intimidation of religious groups by any level of government?”) and the first type of religious hatred or bias measured in SHI.Q.1.a. (“Did individuals face harassment or intimidation motivated by religious hatred or bias?”). For purposes of this study, the definition of harassment includes any mention in the primary sources of an offense against an individual or group based on religious identity. Such offenses may range from physical attacks and direct coercion to more subtle forms of discrimination. But prejudicial opinions or attitudes, in and of themselves, do not constitute harassment unless they are acted upon in a palpable way. As noted above, this study provides data on the number of countries in which different religious groups are harassed or intimidated. But the study does not assess either the severity or the frequency of the harassment in each country. Therefore, the results should not be interpreted as gauging which religious group faces the most harassment or persecution around the world.

Topics

Regions & Countries

Formats

Topics

Regions & Countries

Formats

Overview of Procedures

Countries and Territories

Information Sources

Primary Sources for 2013

The Coding Instrument

The Coding Process

Restriction of Religion Indexes

Government Restrictions Index

Social Hostilities Index

How Examples Are Coded

Effects of Consolidating to a New Database

Changing Time Period of Analysis

Religion-Related Terrorism and Armed Conflict

Changes to Somalia’s Coding

Potential Biases

Coding Harassment of Specific Religious Groups

New Analysis Focused on Religious Minorities

Defining Religious Minorities

Measuring Restrictions and Hostilities Affecting Religious Minorities

Limitations of This Approach to the Study of Religious Minorities

Sign up for our Religion newsletter

Report Materials

Table of Contents

Overview of Procedures

Overview of Procedures

Countries and Territories

Overview of Procedures

Countries and Territories

Information Sources

Overview of Procedures

Countries and Territories

Information Sources

Primary Sources for 2013

Overview of Procedures

Countries and Territories

Information Sources

Primary Sources for 2013

The Coding Instrument

Overview of Procedures

Countries and Territories

Information Sources

Primary Sources for 2013

The Coding Instrument

The Coding Process

Overview of Procedures

Countries and Territories

Information Sources

Primary Sources for 2013

The Coding Instrument

The Coding Process

Restriction of Religion Indexes

Government Restrictions Index

Social Hostilities Index

How Examples Are Coded

Effects of Consolidating to a New Database

Changing Time Period of Analysis

Religion-Related Terrorism and Armed Conflict

Changes to Somalia’s Coding

Overview of Procedures

Countries and Territories

Information Sources

Primary Sources for 2013

The Coding Instrument

The Coding Process

Restriction of Religion Indexes

Government Restrictions Index

Social Hostilities Index

How Examples Are Coded

Effects of Consolidating to a New Database

Changing Time Period of Analysis

Religion-Related Terrorism and Armed Conflict

Changes to Somalia’s Coding

Potential Biases

Overview of Procedures