On Count My Vote, Who is Toeing the Party Line?

Why does the Republican Party in Utah oppose the reform when only one segment of the party seems to oppose it?  Only those who are the most conservative and support the Tea Party seem to prefer the status quo.

Utahns might have the opportunity to reform the caucus/convention system if the proponents of Count My Vote  can qualify the initiative for the ballot.  In November of 2013, researchers at CSED fielded a Utah Voter Poll (UVP) and asked several questions about support for the initiative and reasons for the support.

The poll contains good news for Count My Vote proponents — 64% of UVP respondents favored moving to a primary system. The UVP panel is recruited from actual Utah voters and so this result reflects the current view of those individuals who are likely to vote in November 2014.  Only 9% answered “don’t know,” a relatively small proportion for an initiative a full year before election day.1

Support for Initiative

Question Wording: A proposed initiative seeks to change our electoral system so that Utahns “select political party nominees through a direct vote of the people in a regular primary election.”  Currently, Utah’s system for choosing nominees includes neighborhood caucuses and a state party convention, where party members can meet to discuss the candidates and choose a nominee.   In regards to Utah’s electoral system, which of the following comes closer to your views?

The debate over reform has a clear ideological dimension. In one of the best books written on the politics of reform, The Limits of Electoral Reform, Shaun Bowler and Todd Donavan argue that reform politics have an identifiable dynamic.  Those proposing reforms normally disrupt the qualities of a political system, a fact that results in some counter-mobilization.  The subsequent campaign provides information by which voters recognize whether or not their specific interest may be harmed by the change.  Consequently, support for reforms vary by partisan and ideological interests.

This dynamic of partisan and ideological factions identifying and favoring their political self-interest emerges when we examine support for the reform by party identification.  Only a majority of two categories express support for the status quo: those who identify as strong Republicans and those who identify with some third party.  Most interestingly, the battle is quite close among the strong Republicans, with only a bare majority expressing support.  Otherwise, most all other identifiers support the reform.

Support for Initiative by PID

What this means for Utah is that conservatives are counter-mobilizing to attempt to defeat Count My Vote because they want to preserve their control over the Republican Party and thus over Utah’s one-party system.

Ideology tells essentially the same story.  Only one group among the five ideological categories wants the status quo: those who identify as strongly conservative.  Support for the reform emerges abruptly as the scale moves from right to left.  Individuals who are moderately conservative overwhelmingly support the reform.

Support for Initiative by Ideology

The group that stands to benefit the most—or at least the one that seems to oppose the reform—actively supports the Tea Party.  Individuals who consider themselves active supporters of the Tea Party, only 12% of the November 2013 UVP sample, overwhelmingly oppose the reform.  Almost 80% of the 88% percent of Utah voters who do not consider themselves Tea Party supporters favor the reform.

Support for Initiative by Tea Party Support

Together, the figures on party identification, ideology, and Tea Party support suggest that it is one particular segment of the Republican Party that opposes reform.  To test this idea on many of the possible predictors of favoring or opposing reform simultaneously, I use regression analysis.  Logistic regression is an appropriate method of analysis when the question of interest has two categories.  In addition to party identification, ideology, and active Tea Party support, I also include several other variables or predictors as statistical controls.  These include gender, income, education, and age.

The model indicates that when controlling for multiple possible predictors at the same time, party identification does not matter.2 However, ideology and being an active supporter of the Tea Party do.

The graph below shows the probabilities for different categories of ideology.  The probabilities are estimated holding all of the other variables constant at their average.
The line shows just how steep the decline is across ideology.  As individuals become less conservative, the probability of opposing the reform drops to almost zero.   Importantly, for all categories except “strongly conservative,” the probability of opposing the reform effort is well below 50 percent.

Probability Figure for Ideology

A similar effect occurs for Tea Party support.  As an individual moves from not actively supporting to actively supporting the Tea Party, the probability of opposing the reform increases by almost 30 percentage points.

These findings raise an interesting question: Why does the Republican Party in Utah oppose the reform when only one segment of the party seems to oppose it?  Only those who are the most conservative and support the Tea Party seem to prefer the status quo.  If parties are the vehicles to aggregate and channel opinion to elected officials, the Republican Party seems only to be listening to one part of its party: those who are active supporters of the Tea Party and strongly conservative.

Strong Republicans make up 39% of self-identified Republicans, and only about half of the strong republicans say they are strongly conservative.  This means you can be a strong republican and not strongly conservative.  There are lots of individuals who are both Republican and conservative who support the reform, contrary to what the Party is actually doing.

This mismatch between what some party officials are doing and what the rank-and-file wants raises intriguing questions about the issue of representation, deliberation, and voter sophistication—all issues that I will explore in another post soon.


About Kelly Patterson: Kelly Patterson is a professor of political science at Brigham Young University and a former director of the Center for the Study of Elections and Democracy.

Posted in Everything | Tagged , , , | 4 Comments

Does it matter that the Utah Senate votes twice on each bill?

There’s an odd thing about the Utah Legislature. The Utah House holds only one debate and vote on each bill, but the Utah Senate holds two debates and two votes on each bill.1

Let’s ask three questions about the Senate’s practice of voting twice on bills. First, does it cause Senators to skip the first vote, knowing they’ll have a chance to vote on the bill later? (It does, a little.) Second, do Senators just vote the same way both times they see a bill, or do we see real differences between the two voting outcomes? (They vote the same both times.) Third, do Senators seem to care about the requirement to hold two votes on each bill, or do they routinely waive this requirement? (They waive it almost half the time.) I’ve already told you the conclusions, so let’s dive in.

About the data (technical information)

I’ve got data on every floor vote held in the Utah Legislature from 2007 through 2013. (You’ll find lots of analysis of the voting data here.) To answer my first two questions, I look only at bills that did indeed undergo two floor votes.2

The Senate calls the first vote the “2nd reading” and the second vote the “3rd reading.” To avoid confusion, I will refer to them here as the first vote and second vote. (In the footnotes, which are more technical, I use “2nd reading” and “3rd reading.”)

Are Senators more likely to miss the first vote on a bill?

Yes. On average, 3.7% of Senators miss the first vote on a bill, but only 2.8% miss the second vote. Given that there are 29 Senators, that translates to one additional Senator on the floor during a bill’s second Senate vote. If you want more detail, you can see a post on this topic I wrote a couple years ago.

Do outcomes change much between the first and second vote on a bill?

Not really. Almost three-quarters (72%) of bills get the exact same vote margin on both Senate votes. (By margin, I mean the number of “ayes” as a percentage of the number of non-absent Senators, so the margin ranges from 0 to 100.) With the remaining 28% of bills, there is a bit of wobble but no clear trend; 14% do better on their second vote, but 14% do worse.

Most of the movement is trivial; with 93% of bills, the margin on the second vote is within 10 percentage points of the margin on the first vote. (To see how trivial a 10 percentage point movement is, read this.)

Here’s the most striking part, though: Although I identified a few dozen bills that failed on their first vote, I could not identify a single bill that failed on its second vote after having passed its first one. If the Utah Senate approves a bill on its first vote, you can be all but assured that the bill’s ultimate passage is a done deal.

Do Senators value the second reading calendar?

You’d have to ask them. The answer probably varies. But their behavior suggests that, at least as a body, Utah Senators aren’t particularly fond of the (self-imposed) requirement to hold two separate floor votes on each bill. From 2007-2013, Utah’s Senators waived this requirement for 43% of the bills they heard–sometimes by using the consent calendar process3, but more often by approving a motion to suspend the rules for a particular bill.4

Wrapping up

Utah Senators are (somewhat) more likely to miss a bill’s first vote than its second. Utah Senators have never (in the 2007 through 2013 general sessions) reversed their decision during a bill’s second vote. And Utah Senators routinely waive the requirement to vote twice on each bill, a decision that must be made on a bill-by-bill basis.

What purpose does the Senate’s two-vote requirement serve, then? I can think of one possibility that my dataset does not enable me to address.  When Senators like the general concept of a bill but have some nitpicky concerns, they often vote “aye on two” rather than simply “aye” during the bill’s first vote. “Aye on two” signals to the bill’s sponsor that a particular Senator will vote “nay” when the bill comes back for a final vote unless the bill receives some improvements.

Maybe “aye on two” becomes a self-fulfilling prophecy; the Senate never reverses itself during a final vote because Senators who care about getting their bills passed heed the “aye on two” warning and improve their bills before bringing them back. Unfortunately, official Senate records note only “aye” and “nay”; an “aye on two” vote gets recorded as an “aye.” As such, I can’t really test this hypothesis.

About Adam Brown: Adam Brown is an assistant professor of political science at Brigham Young University and a research fellow with the Center for the Study of Elections and Democracy. You can learn more about him at his website.

Posted in Everything | Tagged , , , | Comments Off

Support for gay marriage is up by 20% in Utah? Not so fast.

It may be the case that the 20% “shift” in support was really a reflection of different question wordings and sample frames.

A year and a half ago, my colleagues posted these polling results showing that 28% of Utah voters support same-sex marriage (as of mid-2012). A few days ago, the Salt Lake Tribune published its own poll showing what appears to be a huge shift: 48% of Utahns supporting same-sex marriage. There is no doubt that Utahns’ support for same-sex marriage is growing (see here), but twenty percentage points? That’s a tremendous shift in a short time.

I have no quibbles with either poll, but be careful before comparing them too hastily. They differ in two key ways. First, the BYU poll sampled Utah voters, while the Tribune poll sampled Utah adults; those are different populations, and they will produce different results. Second, the two polls used different question wording, which can have large effects. Neither poll has a “better” wording or sampling frame; they are just different, and they produce a different look at public opinion in Utah.

You can read a much more detailed analysis of these two points in this post from Scott Riding at Y2 Analytics. (Disclosure: Scott is my former student, and two of my colleagues are closely involved with Y2 Analytics, though I am not.) Scott also reports the results of a new Y2 Analytics poll that replicates the BYU poll’s question wording and sampling method; the new poll does not find much movement. So it may be the case that the 20% “shift” in support was really a reflection of different question wordings and sample frames.

To illustrate the question wording effect, let’s look at two questions within the Tribune poll. Both asked about roughly the same thing, but they got different results. First, the Tribune asked this: ”Should same-sex couples in Utah be allowed to form civil unions or domestic partnerships?” 25% said no. Later, they asked this: “Do you support or do you oppose any legal recognition of same-sex relationships?” 37% opposed.

Let’s think this through. 37 is 12 higher than 25. So apparently 12% of Utah adults oppose any legal recognition of same-sex relationships, yet they support civil unions or domestic partnerships. That makes no sense at all. This doesn’t mean that 12% of respondents are daft. It means that question wording can influence results, sometimes significantly.

Let me stress that I’m not taking sides whether the Tribune poll or the BYU/CSED poll is better. They both seem good to me. But they use different questions and samples, so we need to be careful when comparing them and identifying trends.

If you didn’t click that link to Scott’s post earlier, you should do it now. He has much more to add–especially the results of an additional (recent) poll.

Posted in Everything | Tagged , , , | 1 Comment

Do I Mistrust this Poll? Let Me Count the Ways…

This post was jointly written by Quin Monson and Kelly Patterson.

Recently, the Libertas Institute posted a “survey” on their web site purporting to measure how Utah voters feel about a possible statewide anti-discrimination law to protect gay and transgender Utahns against housing and employment discrimination.

The survey has many issues that cast serious doubt on the validity of the results.  Here is a brief summary of some of the problems.

1. The questions are unbalanced and inaccurate.  For example, the two questions about an anti-discrimination law contain references to “jail time.”  However, jail time is not part of anyone’s anti-dicrimination ordinance or law.  What Libertas calls “contextualized” simply means asking loaded questions by introducing the threat of a non-existent punishment.

In addition to inaccurate questions about anti-discrimination, the question order is a serious concern.  The relevant questions are preceded by questions about free association and religion.  This order effectively biases the survey participants by having them consider reasons why they would not want a law right before they are asked about a possible law.

2.  The robocall methodology used by Libertas is not methodologically sound.  Robocalls cannot obtain a valid representative sample of any population of interest because they have no way to select or ask for a respondent within the household they are calling.  Many valid surveys ask for a respondent by name from a list.  Or, if the poll is conducted on a random list of phone numbers, a method is employed to select a person at random within the household.  For example, many pollsters ask to speak to the person who celebrated the most recent birthday. This poll could have been answered by someone’s 14 year old, and they would never know. The survey is supposed to represent voters, but this is virtually impossible to verify.  The poll contains no gender question.  Because they take whomever answers the phone, it is likely that the respondents are disproportionately female.  Voters in Utah are evenly split 50/50 between men and women.   Finally, a heavy proportion (37%) of the respondents are over 60 years old.  This too is disproportionately high.

3.  The survey also has some serious ethical and possible legal problems.  One serious issue is that they posted a data file on their web site that includes the actual phone numbers of the people they called.  This is a huge violation of trust.  The American Association of Public Opinion Research follows a code of professional ethics that you can find here. The relevant part that this survey violates says, “Unless the respondent explicitly waives confidentiality for specified uses, we shall hold as privileged and confidential all information that could be used, alone or in combination with other reasonably available information, to identify a respondent with his or her responses. We also shall not disclose or use the names of respondents or any other personally-identifying information for non-research purposes unless the respondents grant us permission to do so.”  They did not release the full script of the robocall, but we are guessing that they did not tell participants that they would be releasing their phone numbers publicly.  This would have led many people to hang up on the call and would make many of the existing respondents very angry.

We are also worried that they robocalled cell phones.  If so, this is actually illegal under federal law.  They could be in serious trouble if someone filed a complaint.

In their write up of the “survey,” Libertas claims that “These results validate our initial theory…”  Unfortunately, good social science does not validate theories, it simply rejects null hypotheses at certain levels of confidence.  We have no confidence in this survey.

Posted in Everything | 10 Comments

What kind of Republican is Spencer Cox?

Spencer Cox is about as run-of-the-mill of a Republican as Utah can produce.

Governor Gary Herbert has nominated Spencer Cox to replace Greg Bell as Utah’s new Lieutenant Governor. Few outside the Legislature had heard Cox’s name before the governor’s announcement. Even within the Legislature, few knew his name before he began his legislative service less than one year ago.

Today the Legislature will consider the governor’s nomination and, in all likelihood, confirm him as Utah’s new Lieutenant Governor. The Tribune ran a good biographical profile of Cox today. I thought I would add a quick look at his Legislative voting record.

Because Cox served in the Utah House, we can use voting records to get a feel for what type of political ideology Cox might espouse. Using all the “ayes” and “nays” cast in the Legislature, we can apply a well-tested method to line up all the legislators from most liberal to most conservative. (You can read more about how these scores work here.)

On a scale from -100 (more liberal) to +100 (more conservative), Spencer Cox rates a +28.4. This places him almost exactly at the center of the House Republican caucus. For House Republicans, the average (mean) score was +28.7, and the median was +27.4. Cox’s voting record makes him most similar to Brad Dee (House Majority Leader), followed by Mike McKell (Cox’s brother-in-law) and Dean Sanpei (House Rules Chair). Indeed, Cox’s record is almost indistinguishable from any of these Representatives.

The chart below gives another way of considering how Cox’s voting ideology lines up with other legislators. I grouped ideology scores for the 75 Representatives who served in 2013 into bins 10 units wide (the left column in the table below). In the right column, I wrote one “D” or “R” for each legislator within each bin. For example, there were three Democratic Representatives with scores between -100 and -90, hence the “DDD” in the right column. Cox’s score is highlighted in red, in the politically safe area near the center of the House Republicans.

Bin Legislators
-100 to -90 DDD
-90.1 to -80 DDDD
-80.1 to -70 DDDDDD
-70.1 to -60 D
-60.1 to -50
-50.1 to -40
-40.1 to -30
-30.1 to -20 RRR
-20.1 to -10 R
-10.1 to 0 RRRRR
0.1 to 10 RRRRRRR
10.1 to 20 RRRRRRRRRR
20.1 to 30 RRRRRRRR
30.1 to 40 RRRRRR
40.1 to 50 RRRRRRRRR
50.1 to 60 R
60.1 to 70 RRRRRR
70.1 to 80 R
80.1 to 90 RRRR
90.1 to 100

What do we conclude? From his legislative voting record, it seems Spencer Cox is about as run-of-the-mill of a Republican as Utah can produce. Voters have no more reason to love or fear him than they would any typical Utah Republican official.

Posted in Everything | Tagged , , , , , , , , | Comments Off

New ideology ratings for the Utah Legislature

Two years ago I released ideology scores for each Utah legislator who served between 2007 and 2011. Today I’m releasing an update that extends the scores through 2013. (Thanks to my research assistant, Justin Chang, for invaluable help.) I’ve written in more detail about the methodology behind the scores in the past.

Please take a moment to understand the origins and limitations of these ideology scores.

  • I use the W-NOMINATE algorithm, originally developed to study the U.S. Congress, and widely used among political scientists for that purpose.
  • The W-NOMINATE algorithm takes account of every vote cast on the floor of the Utah House or Utah Senate.
  • Scores are relative. That means there is no score that means “liberal” or “conservative.” A score of +43 or -21 means nothing by itself. But a legislator with a score of +43 is relatively more conservative than a legislator with a score of +38, who is, in turn, relatively more conservative than a legislator with a score of -4. Higher scores are relatively more conservative than lower scores.
  • Scores are placed on an artificial score ranging from -100 (more liberal) to +100 (more conservative), but a score below 0 does not mean “liberal,” just as a score above 0 does not mean “conservative.” Rather, because scores are relative within the Legislature itself, then 0 simply indicates the legislator at the ideological center of his/her chamber. Because the Legislature is over 80% Republican, the 0 point will almost certainly be occupied by a Republican.
  • Scores are comparable only within a single chamber, and only within a single year. You cannot compare a House score to a Senate score, or a 2008 score to a 2012 score. Why? Because the scores are relative within each chamber and year. Even if every legislator, Republican or Democratic, moved dramatically to the between year X and year Y, the scores would still be forced by the W-NOMINATE algorithm to fall between -100 and +100 each year.

The complete scores are available on my personal website. You can start here: House (2013) and Senate (2013).

I’ll post some followups in coming days making use of these scores. The main purpose of this post is just to explain how the scores work so that I have something to link to when future posts make use of them.

Posted in Everything | Tagged , , , , , | Comments Off

Senator Lee and the Shutdown

Lee has overwhelming support from the quarter of the population that doesn’t reject the Tea Party.  But the three-quarters of Utahns who do not identify with the Tea Party come to the exact opposite conclusion.

Senator Mike Lee has received considerable attention nationally, within Utah, and even among his fellow U.S. Senators for his role with Senator Ted Cruz in executing a strategy to defund the Affordable Care Act (widely known as Obamacare).  The tension continues to rise with the government shutdown and the possibility that this will lead to a failure to raise the debt ceiling.

So what do Utahns think about all of this?  Who views Senator Lee’s work favorably or unfavorably? And how does this all compare with the recent past?  The Center for the Study of Elections and Democracy at BYU just completed another Utah Voter Poll that allows us to answer these and other questions.

We asked respondents to choose between whether “Senator Mike Lee should stand by his principles, even when the result is a government shutdown” or “Senator Mike Lee should be more willing to compromise, even if that means passing a budget with funding for the Affordable Care Act.”

Lee Figure 1

First of all, 57% of Utahns overall would like Senator Lee to be “more willing to compromise” versus 43% who prefer that he “stand by his principles.” That result is not possible in Republican-dominated Utah without at least some Republicans preferring compromise.  In fact, 38% of all self-identified Republicans prefer that Lee compromise compared to 99% of all Democrats.  Independents side heavily with compromise at 65%.

A look at this question by active support for the Tea Party support yields absolutely stunning conclusions.  Among the 13% of respondents who identify as active Tea Party supporters, 90% say that Lee should stick to his principles and not compromise.  Among those who say they are not active supporters (74% of the sample), 73% say he should compromise.

The 13% who answer “Don’t Know” to the Tea Party question are also interesting.  Of this group, 80% say stick to his principles, 20% say compromise.  Those answering “Don’t Know” appear to be Tea Partiers hiding in the “Don’t Know” response option.

All told, then, Lee has overwhelming support from the quarter of the population that doesn’t reject the Tea Party.  But the three-quarters of Utahns who do not identify with the Tea Party come to the exact opposite conclusion.

But here’s the further complication:  among those who identify as Republicans but do not support the Tea Party, the split is 51/49 in favor of compromise.  Recall, that among all Republicans (Tea Party supporters or not), support for “standing by his principles” is very strong — 62/38.

So, how vulnerable is Lee because of his tactics on Obamacare and the shutdown?  On this issue he has near total support from the Tea Party and about half of the non-Tea Party affiliated Republicans.  He has generated some opposition within his own party because of his actions, but on balance and buoyed by the overwhelming support for Tea Partiers, his tactics in the budget fight still enjoy the support of most Republicans.

That said, Lee’s stance has carried over into his favorability ratings.  Compared to our June 2013 Utah Voter Poll, Senator Lee’s favorability fortunes have reversed course.  In October the favorability to unfavorability ratio is 40/51 while back in June 2013 it was 50/41.  More Utah voters now have an unfavorable impression of him.

Lee Figure 2

To put Lee’s current favorability numbers in the proper context, we’ve put them side by side with Jim Matheson’s current numbers, after all Matheson’s name always comes up in discussions of statewide elections. Just for fun, we’ve thrown in some favorability numbers for Senator Bob Bennett from the March 2010 Utah Voter Poll.   Matheson’s favorable to unfavorable ratio is 58/36, not great compared to Governor Herbert who is at 71/25 (not shown in the figure), but not bad for a Democrat amidst a sea of Republicans.  Notably, Lee is also now clearly behind the numbers of former Senator Bennett from our March 2010 Utah Voter Poll.

When you break the numbers down into “very” and “somewhat” favorable ratings, you see that Senator Lee is a polarizing figure.  His highest ratings are for “very unfavorable” (40%) followed by “very favorable” 26%.  Lee’s very favorable numbers are also virtually unchanged from June.  The change is from somewhat favorable to very unfavorable. Moderate Republicans who once gave Lee a lukewarm thumbs up are now giving him a strong thumbs down.  Matheson and Bennett, in contrast, are highest on the middle “somewhat” categories.

Lee Figure 3

So how is Senator Lee doing among members of his own party?  Back in June he was a rock star with a 71/22 favorable to unfavorable rating.  That’s now fallen off quite a bit, but it’s still at a respectable 57/33.  Is Senator Lee vulnerable to a challenge from the moderate wing of the Republican Party?  Maybe.  Check out former Senator Bennett’s numbers among Republicans in March 2010.  At 57/38 they look a lot like Lee’s do now.  If Lee draws a strong Republican challenger, it would be difficult to predict the outcome right now.  A lot would depend on who shows up to the caucus meetings and the composition of the delegates.  If the Count My Vote initiative is successful, all bets are off.

Lee Figure 4

A strong general election challenger presents a real danger spot for Senator Lee.  Notice Representative Matheson’s favorability/unfavorability ratio among Republicans statewide are is 52/40.  Matheson doesn’t need a majority of Republican votes to win a statewide election, he just needs between a quarter and a third.  That’s been his recipe for success for the last decade plus in his House elections.  That appears very doable right now.

Lee Figure 5

When the Republican only numbers are examined in more detail, once again Senator Lee’s “very favorable” numbers hold pretty constant from June to October.  The voters that always really like him haven’t changed their minds much and his current stance may simply reinforce those views, but he has driven away a group of voters that he will badly want back if he ever faces a strong challenger.  The difficulty for Democrats is finding a challenger with the capacity to win statewide who is willing to run.  The short list is indeed very short.

Altogether, these results are indicative of the larger difficulty within the Republican Party.  While Senator Lee enjoys intense support from a vocal minority and seems to be representing their perspective very well, he does so at his own peril.  The majority of Utah voters are looking for him to compromise and if he fails to do so, he could face electoral consequences.

Survey Methods

Click here to download a topline report that includes the full survey questionnaire, frequencies for each question, a detailed methodological report (including details about the sampling as well as response rates and cooperation rates) and information about the margin of sampling error.


About Quin Monson: Quin Monson is Associate Professor of Political Science and Director of the Center for the Study of Elections and Democracy at Brigham Young University.

Posted in Everything | Tagged , , , , , , , , , | 16 Comments

“Convicted? No, never Convicted.”

71% of Utah voters still think that the Attorney General should resign.  That number is down from 78% in June, but it still represents a sizable share of the population.

We take the title for this post from that classic patriotic movie Stripes.  In this movie, Bill Murray plays a down-on-his-luck character who decides to turn his fortunes around by joining the army.  Before he can enlist, he needs to answer a question from the recruiter: “Have you ever been convicted of a felony or misdemeanor?”  Murray’s character says “Convicted? No.” And his sidekick chimes in, “Never convicted.”

Such seems to be the current condition of Attorney General Swallow.  With the news that the Federal Government has decided not to charge him, he can say, like the characters in Stripes, “Charged? No, never charged.”   The salient question is whether or not that bit of news strengthens his position with Utah Voters.

In a June Utah Voter Poll, 34% of the respondents said that they thought he had done something illegal.  In the October poll, that proportion drops to 26%.  Many of those respondents from the June poll moved to the choice that “he has done nothing illegal, but he has done something unethical.”  That number increases from 62% in the June poll to 66% in the October poll.  The proportion that says he has done “nothing unethical” stays in single digits but increases from 4% in June to 8% in October.  Swallow’s lawyer might enthusiastically call this a 100 percent increase, but it is safer to say that it is within the margin of error.

Done Something Illegal

Though there has been some small movement away from the conclusion that Swallow has done something illegal, overall less than 10% of respondents believe that the attorney general has acted ethically – a precarious position for the state’s chief law enforcement officer.

Other results only emphasize that precariousness.  71% of Utah voters still think that the Attorney General should resign.  That number is down from 78% in June, but it still represents a sizable share of the population.

Should Resign

Scandals create complexity and nuance in public opinion.  Much of what respondents say about scandals depends to a large extent on what information respondents have to help them sort through the choices pollsters offer them (Shah et al. 2002; Zaller 1998; Funk 1996; Zaller 1992).  And not all information is created equal.  Negative often has a bigger impact than positive because it can be more memorable; respondents also tend to favor recently received information because it is generally easier to summon.

To test the extent to which knowledge of the Swallow scandal shaded public opinion, we inserted a framing experiment into the October poll.  Framing experiments allow the researcher to vary the information given to the respondent in order to assess the impact of different kinds of information.

Specifically, we wanted to know if the decision of the Federal Government not to charge AG Swallow would affect support for continuing the investigation undertaken by the Utah House of Representatives.

We used four treatments.  Voters were randomly assigned to either the control or one of the four treatments.  Each treatment contained slightly different information about the nature of the investigations facing the Attorney General.  The exact wording of these treatments is provided in the endnote.1

Remember that the control was the overall support for continuing the House investigation.  The control contained no additional information.  Overall, almost 74% in the control said it should “definitely” or “probably continue.”

However, the proportion that says that the investigation should continue depends on the information that the respondent has fresh in the mind.  The best news emerges in Treatments 1 and 2 where voters are told that the AG has either been “cleared of bribery accusations” (50%) or the Justice Department “would not seek bribery charges against him” (52%).  With that type of information in mind, the support for a House investigation declines.

Differences Across Treatments

The proportion that wants the House investigation to continue climbs higher in Treatments 3 and 4.  In Treatment 3, the stronger language of “cleared” is used along with a reminder of ongoing investigations by other entities.  Here, 57% want the House investigation to continue.  Treatment 4 uses softer language.  It does not refer to “cleared” but only to the Department’s decision not to pursue charges.  56% want the House investigation to continue under this treatment.2

Overall, even after directly reminding Utahns of the Justice Department’s decision not to proceed, a majority of respondents still prefer the House investigation to continue.  But the support for the House investigation is also sensitive to the contextual information that is provided.  What the public knows and recalls matters for the distribution of opinion.  The AG needs good news to reduce the large deficit of public trust he currently faces.


Click here to download a topline report that includes the full survey questionnaire, frequencies for each question, a detailed methodological report (including details about the sampling as well as response rates and cooperation rates) and information about the margin of sampling error.


Funk, Carolyn L. 1996. “The Impact of Scandal on Candidate Evaluations: An Experimental Test of the Role of Candidate Traits.” Political Behavior 18(1): 1-24.

Shah, Dhavan V., Mark D. Wattts, David Domke, and David P. Fan. 2002. “News Framing and Cueing of Issue Regimes: Explaining Clinton’s Public Approval in Spite of Scandal.” Public Opinion Quartery 66(3): 339-370.

Zaller, John R. 1998. “Monica Lewinski’s Contribution to Political Science.” PS: Political Science and Politics 31(2): 182-189.

Zaller, John R. 1992. The Nature and Origins of Mass Opinion. New York: Cambridge University Press.

Posted in Everything | Tagged , , | Comments Off

A Clear Majority of Utah Voters Want the Legislature to Impeach Swallow

When a majority of strong partisans from a politician’s own party favor impeachment, that politician is in serious trouble

Update/Correction:  Although the numbers posted in the topline report were released correctly yesterday, the graphic and prose for the favorability numbers posted here contained an error.  The “favorable” numbers correctly joined “very” and “somewhat” favorable.  However, the “unfavorable” numbers only listed “very unfavorable” instead of adding the two together.  This mistake occurred for all of the candidates as I created the graphic and was then carried into the text.  I have now corrected the post to reflect the numbers from the topline and apologize for my error.  Thanks to Bob Bernick’s eagle eye for comparing the graphic to the topline and pointing out the discrepancy.

Numerous allegations have been made about Utah Attorney General John Swallow in recent weeks.  Public sentiment about the controversy has been largely absent from the discussion.  With Swallow mounting a more public defense in the last few days and legislators on the cusp of a meeting to discuss the charges and possibly move forward on impeachment, the Center for the Study of Elections and Democracy at BYU fielded a Utah Voter Poll that included a host of questions about the controversy. Detailed analysis comes below.  Here are the highlights:

  • John Swallow’s favorability is extremely low, now sitting at 12%  (combining “somewhat” and “strongly” favorable).  Less than 2% respond “strongly favorable.”
  • News of the accusations against Swallow is widespread among voters, and folks who have heard about it overwhelmingly believe that Swallow has committed ethical or legal infractions.  87% of Utah voters have “heard, read, or seen anything recently about the accusations,” and of this group, 34% think Swallow has done something illegal and 63% respond that he has done something unethical.  Less than 4% believe that Swallow has done nothing unethical.
  • A strong majority of voters favors beginning the impeachment process. After a brief introduction to the Utah impeachment process, 72% say the Utah House of Representatives should allow formal impeachment proceedings to begin.
  • When the roughly one quarter of Utah voters who do not want impeachment to begin are asked why not, 62% say that the legislature “should wait until the criminal investigations are complete.”  Only 4% say so because they “don’t believe the accusations.”
  •  The electoral consequences of beginning impeachment proceedings now are low. When asked if their own legislator voted to begin impeachment proceedings, a plurality of Utah voters (35%) say that doing so would increase their support for the legislator, while a majority (56%) say it would “neither increase nor decrease my support.”  Only 9% of voters respond that doing so would decrease their support.
  • Finally, at the end of the sequence of questions we asked, “Thinking about everything you have read or heard about the John Swallow situation, which of the following comes closest to your view of what should happen right now?”  78% say Swallow should resign and 22% say he should stay in office.


Most of the time, elected officials are pleased when the ratio of favorable to unfavorable attitudes about them is at or above 2:1.  Governor Herbert enjoys a 3:1 ratio and Congressman Matheson is not far behind.  Utah’s two senators both sit near a 1:1 ratio that signals that most of their constituents are reasonably happy with their performance.   John Swallow’s ratio at nearly 1:7 is so backwards that it would cast a dark shadow over any elected official unlucky enough to have such low favorability.  Swallow’s 12% favorability is nearly 40 percentage points below that of Senators Lee and Hatch and over 60 percentage points below Governor Herbert.

Swallow Favorability CORRECTED

Do Republicans and Democrats differ on these questions?

When we examine the various questions about Swallow using partisan identification, two things become clear.  Not surprisingly, there are some partisan differences on questions about Swallow’s behavior generally as well as about both impeachment and resignation.  However, Utahns of all political stripes agree that elected officials should move forward to resolve the situation.  88% of Democrats and 75% of Independents want the legislature to begin impeachment proceedings now.  Republican support for impeachment is slightly lower, but even a large majority of Republicans (65%) want the legislature to begin the process.  This is also true for a clear majority (54%) of “strong Republicans” – who might be thought of as Swallow’s last line of defense.  Of the “strong Republicans” who do not favor impeachment, only 9% say it is because Swallow did nothing wrong or because the charges are not serious enough.  Of those strong Republicans who want to wait, the vast majority (72%) responds that they prefer the criminal investigations to be complete first.  When a majority of strong partisans from a politician’s own party favor impeachment, that politician is in serious trouble, especially when less than ten percent of those believe that the charges are minor or untrue.

Swallow Impeach

Swallow Resign

Additional Implications

We asked a few additional questions to try to unpack some of the other facets of this ongoing story.  Ethics and campaign finance reform constantly returns to the agenda of the state legislature and this scandal may yet bring us additional attempts at reform.  We get a taste of public preferences in the context of this particular story with an agree/disagree question that says, “The attorney general should not take campaign contributions from businesses he is supposed to regulate.”  More than 90% of voters agree with this statement and 76% strongly agree.

Some have defended Swallow by asserting that “he has been a victim of the media.”  A quarter of voters are ambivalent about this statement, while only about a third of voters agree and a plurality (40%) disagree.  In other words, most voters do not believe that Swallow has been the target of an unfair media campaign.

Voters harbor strong doubts about whether or not Swallow can “still be an effective attorney general.”  Only 21% of voters agree that Swallow can still be effective while 61% disagree.


Click here to download a topline report that includes the full survey questionnaire, frequencies for each question, a detailed methodological report (including details about the sampling as well as response rates and cooperation rates) and information about the margin of sampling error.

Posted in Everything | Tagged , , , , , , , , , , | Comments Off

Utah’s Supreme Court, where unanimity is the rule

Non-unanimous rulings from the Utah Supreme Court are very rare

The five Justices serving on Utah’s Supreme Court are the final word when it comes to interpreting Utah law and Utah’s Constitution, yet they labor mostly in obscurity, without attracting the sort of public attention that the U.S. Supreme Court attracts. Perhaps that’s because so many of the Utah Court’s rulings are issued unanimously, without the narrow-majority drama that we see in the U.S. Court. In fact, the Utah Court went through a period where non-unanimous decisions were rare–a period that has only recently begun to change.

Composition of the Court

Utah’s Supreme Court consists of five Justices. Utah employs a merit-based nominating system intended to favor expertise over ideology. Still, I’ll start with a simple graph showing how the composition of the Court has changed during the period I’ll be looking at (1997 through 2012). From 1997 through March 2000, four Justices were Democratic appointees (i.e. appointed by a Democratic governor, regardless of the Justice’s own partisanship); from March 2000 through May 2003, only two justices were Democratic appointees; since May 2003, only one Democratic appointee remained on the Court.

Partisan composition of Utah Supreme Court justices

Number of Utah Supreme Court justices appointed by governors of each party, by year

How much dissent is there?

Based on the previous figure, you might expect that 2000-2003 was a tumultuous time for the Court, with many narrowly divided rulings. You would be wrong. The chart below shows the percentage of rulings each year that were issued with anything less than unanimity (i.e. a 4-1 or 3-2 ruling). In 1997 and 1998, 20-25% of rulings triggered at least one dissent. Divided rulings fell sharply from 2000 to 2002 and were rare from 2003 through 2006.

Frequency of non-unanimous decisions by the Utah Supreme Court

Frequency of non-unanimous decisions by the Utah Supreme Court, by year

Even today, despite a modest rise in divided rulings, they still remain relatively rare. The Court hears only 80-100 cases in a typical year. In practical terms, that means we’re looking at only a handful of non-unanimous rulings each year, typically fewer than 10. Reporters take note: Non-unanimous rulings from the Utah Supreme Court are very rare–so rare that they probably deserve some media attention.

Which Justices dissent most often?

This leads us to a natural question: Which Justices are most willing to disagree with the majority? Ten Justices served at one point or another from 1997 through 2012. In the table below, I’ve listed how frequently each Justice dissents from the majority. (The Justices are sorted by the year they left the Court; if they are still on the Court, they are sorted by the year they joined it.) Daniel Stewart and Thomas Lee have been most willing to disagree with the majority’s opinion, although even they joined the majority roughly 90% of the time.

Justice Gov’s party Years Dissents
D. Stewart D 1979-2000 11%
M. Zimmerman D 1984-2000 5%
R. Howe D 1980-2003 4%
L. Russon R 1994-2003 4%
C. Durham D 1982- 4%
M. Wilkins R 2000-2010 4%
M. Durrant R 2000- 2%
J. Parrish R 2003- 1%
R. Nehring R 2003- 2%
T. Lee R 2010- 10%

Which Justices write the most opinions?

Every Court ruling requires a written majority opinion. (At their option, Justices can also release their own written concurring or dissenting opinion.) With 5 Justices on the Court, we would expect each Justice to write roughly 20% of the Court’s majority opinions, and that is roughly what we see. The only Justices outside the 18-22% range are Stewart (17%) and Lee (27%). (Side point: Given that Lee dissents relatively frequently, it is remarkable that he is also the most common author of majority opinions. His willingness to dissent has apparently not alienated his colleagues.)

What’s more interesting, though, is to see which Justices take the time to write concurring or dissenting opinions laying out their own thinking separately from the official majority opinion. Although every ruling needs a written majority opinion, nothing compels a Justice to release or concurring or dissenting opinion other than a desire to formally articulate his or her thoughts on a case. Thomas Lee is prolific in this respect. Whereas some justices release a concurring or dissenting opinion in only a handful of cases that they hear, Lee releases them in 16% of the cases he hears. When we combine his concurring and dissenting opinions with his majority opinions, we see that he releases a written opinion of one type or another in 43% of the cases he hears—almost half. Lee’s closest competition in the period under examination is Michael Zimmerman, who released written opinions one-third of the time.

The table below gives the data.1

Justice Majority opinion Other opinion Any opinion
Stewart 17% 10% 27%
Zimmerman 22% 11% 33%
Howe 22% 7% 29%
Russon 21% 5% 26%
Durham 21% 6% 26%
Wilkins 20% 5% 24%
Durrant 23% 2% 25%
Parrish 21% 0% 22%
Nehring 22% 3% 23%
Lee 27% 16% 43%

About the data

You can find all the Utah Supreme Court’s rulings since 1997 online. Over the winter, my research assistant Luke Bell, presently a CSED Student Research Fellow, combed through all the rulings from 1997-2012 and recorded information about them into a spreadsheet. It came out to over 1400 rulings. Occasionally, a Justice recuses or is absent and a lower court judge sits instead. I omit the small percentage of rulings where a sitting judge wrote an opinion–any opinion–but I keep rulings where a sitting judge joined without writing an opinion.

Posted in Everything | Tagged , , | Comments Off