[ View menu ]

January 18, 2010

In Tilburg, they really know how to live

Filed in Gossip ,Jobs
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

TWO PROFESSORSHIPS IN SOCIAL PSYCHOLOGY IN TILBURG, NETHERLANDS

Decision Science News recently visited the Marcel Zeelenberg, Diederik Stapel, Gideon Keren and the gang (which is a very impressive gang indeed) at Tilburg in the Netherlands. It left with the impression that its other visitors (another very impressive gang) had–that this is a first rate place to work in psychology and behavioral economics, as well as one in which the people there really know how to live. Savoir faire, joie de vivre, they have it all. Why stay where you are with happiness level X when you could apply to Tilburg and, if you make it, achieve happiness level 2X? Interested? Read on:

TILBURG SCHOOL OF SOCIAL AND BEHAVIORAL SCIENCES
Tilburg University is a modern, specialized university. The teaching and research of the Tilburg School of Social and Behavioral Sciences are organized around the themes of Health, Organization, and Relations between State, Citizen, and Society. The school’s inspiring working environment motivates people to realize their ambitions; involvement and cooperation are essential to achieve this.

DEPARTMENT OF SOCIAL PSYCHOLOGY
The Department of Social Psychology of Tilburg University is an intellectually exciting and productive group, advancing fundamental understanding in the areas of social, economic and work & organizational psychology, whilst also contributing to effective practice in organisations and society. The basic and applied research of the department is highly recognized both nationally and internationally.
The overarching research program of the Department of Social Psychology is Social Decision Making. The Department of Social Psychology participates in the interdisciplinary Tilburg Institute for Behavioral Economics Research (Tiber), devoted to studying the psychological processes underlying individual choice and economic decision making from an interdisciplinary perspective.

Two Tenure Track Positions in the Department of Social Psychology
(both positions are full-time, F/M)
Vacancy number: 400.10.03

Members of the Department of Social Psychology supervise students and teach a variety of modules at both Bachelors’ and Masters’ level and participate in the two-year Research Master, covering a variety of significant topics from Social Psychology, Economic Psychology and Work & Organizational Psychology.

Job description
We are searching for candidates in the area of social psychology, economic psychology or organizational psychology. The successful candidates teach two or three courses that are part of the Bachelor or Master Programmes, and will supervise theses at bachelor and master level. And they are encouraged to seek external grant funding.
The tasks are:
• Publishing articles in high quality scientific journals,
• Teaching courses (in Dutch or English) in the programs offered by the department, on the BSc and MSc level.
• Supervising individual student projects at BSc – and MSc -level.
• Performing departmental service

Requirements
• PhD in Social Psychology or related areas.
• Passionate researcher/teacher.
• High quality publication record.
• Experience and affinity with teaching in the relevant area.
• Excellent command of the English language.
• Ability to attract funding
• For non-Dutch candidates: readiness to learn Dutch

Terms of employment
Tilburg University is among the top of the Dutch employers and has an excellent policy concerning terms of employment. For a tenure track Assistant Professor a four-year contract applies, with the possibility of tenure (and furthering one’s growth potential up to the rank of full professor) thereafter. The starting salary for the position of an Assistant Professor on a full-time basis ranges between € 3195,- and € 4374,- gross per month. Secondary benefits are excellent in general and include e.g. a pension scheme, flexible employment conditions and salaries that are supplemented with a holiday bonus of 8% (in May) and a year-end bonus of 8,3% (in December) of the annual 12 month salary. Depending on the candidate’s qualifications, appointment at the associate professor level can be considered, in which case the salary will be adjusted accordingly.

Applications and information
Additional information about Tilburg University and the Department of Social Psychology can be retrieved from: www.uvt.nl. Specific information about the vacancies can be obtained from one of the following professors: Marcel Zeelenberg (Marcel@uvt.nl, telephone +31134668276), Diederik Stapel (D.A.Stapel@uvt.nl, telephone +31134663424), Ilja van Beest (I.vanBeest@uvt.nl, telephone +31134662472), Christel Rutte (telephone +31134662408).

Applications, including a curriculum vitae, a letter of motivation, and two recent (forthcoming) publications should be send only by e-mail, before March 1, 2010 to mister M. van Ieperen, Managing Director Tilburg School of Social and Behavioral Sciences, Tilburg University to e-mail: PZ-FSW@uvt.nl. Please refer to vacancy number 400.10.03.

January 11, 2010

Predictions, theories, and dangerous things

Filed in Books ,Ideas ,Profiles
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

TALEB INTERVIEWS FROM BEFORE AND AFTER THE DOWNTURN

Making predictions is risky business. If you make a claim like “Dow 30,000 by 2008“, it’s more than a little embarrassing when you’re wrong. (If you’re wondering, the Dow’s peak was just over 14,000).

But making predictions is important. Science, for instance, suffers when theories are vague and when models have so many free parameters they can never be falsified. As it has been said in the classic book Plans and the Structure of Behavior:

A good scientist can draw an elephant with three parameters, and with four he can tie a knot in its tail.

In other words, if your theory is so general-purpose that you can draw an elephant with it, what picture can’t you draw with it?

(Incidentally, I get this quote from Seidenberg who good naturedly says that one of his own quarter-million-edge neural networks “can presumably draw every hair on the elephant’s back”).

In Nassim Taleb’s book The Black Swan: The Impact of the Highly Improbable and quite a few interviews, he went on record to say that the prevailing conditions were a powder keg. Have a listen to these interviews from him (from the EconTalk podcast series) before and after the mess:

Pre-Downturn (April 30, 2007). Dow Jones closed at 13,063.
Taleb on Black Swans

Post-Downturn (March 23, 2009). Dow Jones closed at 7,776.
Taleb on the Financial Crisis

Photo credit:http://www.flickr.com/photos/great_driffield/4263493722/

January 4, 2010

Money to study nudges in medicine

Filed in Programs ,Research News ,SJDM
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

GET $7,500,000 TO INVESTIGATE NUDGES IN MEDICINE

People who have suffered heart attacks can improve their chances by taking aspirin and other medicines. There is a great deal of research on this, yet, we still don’t see 100% of hospitals prescribing these drugs, and the rate of prescription varies from region to region. In general, the US government has noticed “surprisingly modest behavioral response of health care providers and health care systems to information concerning treatments or procedures judged to be superior”.

How can we get the health practitioners to make decisions in line with evidence?

Techniques such as setting defaults have had profound effects in business and organ donation. Why not in medicine?

The goods new for you, decision-science-researching reader, is that the National Institutes of Health (NIH) and Agency for Healthcare Research and Quality (AHRQ) are looking to give away $15 million dollars to fund two projects on the effectiveness of nudges on health care practices. The executive summary and parts of the background section make for some interesting reading. Sorry about all the abbrevs.

Executive Summary

This NIH Funding Opportunity Announcement (FOA), supported by funds provided to the NIH and AHRQ under the American Recovery & Reinvestment Act of 2009 (“Recovery Act” or “ARRA”), Public Law 111-5, invites applications proposing clinical trials using the principles of behavioral economics to enhance the uptake of the results of comparative effectiveness research (CER) among health care providers in their practice. For this FOA, applicants must propose controlled trials that randomize units (whether individuals or clusters such as practices, hospitals, or larger units) to conditions, resulting in a randomized clinical trial (RCT) or cluster randomized trial (CRT). Research to foster the uptake of CER is seen to be necessary given the surprisingly modest behavioral response of health care providers and health care systems to information concerning treatments or procedures judged to be superior in CER trials. An additional possible benefit is that some behavioral economic interventions to promote the uptake of CER (e.g., those that rely on manipulating a provider’s default options) could be more cost effective than conventional approaches including some pay for performance schemes (P4P). For the purposes of this FOA, the definition of comparative effectiveness research will adhere to that adopted by the Federal Coordinating Council given at http://www.hhs.gov/recovery/programs/cer/cerannualrpt.pdf. Behavioral economics refers to the interdisciplinary efforts involving cognitive and social psychologists, decision scientists, and other social scientists together with economists to model economic decision-making and consequent actions. The approach is inclusive, since at its heart it tries to take into account what is known about how people actually make decisions rather than relying on the assumption that economic agents are fundamentally rational in the sense of expected utility theory (see, e.g., Kahneman and Tversky’s (1979) work on Prospect Theory and Kahneman’s (2003) Nobel lecture). It is hoped that this line of research will lead to significantly greater consideration of CER by health care providers and therefore enhance the quality of the nation’s health.

From the Background section:

Comparative effectiveness research (CER) holds significant promise to improve health care quality and potentially lower costs. It appears that knowledge of which procedures and treatments are comparatively effective may not be sufficient to change critical provider practices and crucial patient behaviors. For example, although the prescription of aspirin, beta blockers, and ACE inhibitors/ARBs after acute myocardial infarction (AMI) has been shown to be extremely effective in clinical trials, strongly endorsed by professional societies such as the American College of Cardiology, and used as a quality indicator by government organizations including the Centers for Medicare and Medicaid Services (CMS), rates of prescription for these drugs in hospitals following AMI show substantial regional and institutional variation and are still below 100% according to the 2008 AHRQ National Healthcare Quality Report (NHRQ). Even when comparatively effective treatments are prescribed, adherence to treatment can be disappointingly low. For example, approximately 50 percent of all AMI patients stop taking prescribed statins within two years of their event as late as the beginning of this decade (Jackevicius et al., 2002). Among asthmatics, only 32% took their preventive asthma medicine daily. Similar adherence problems exist among diabetics, resulting in poor health outcomes. Fewer than 60% of all adults age 40 and over with diagnosed diabetes have their blood sugar, cholesterol, or blood pressure under optimal control. Only 40.1% receive all three recommended services for diabetes, including an HbA1c measurement, a dilated eye examination, and a foot examination. (2008 AHRQ National Healthcare Quality Report)

It is generally presumed that both providers and patients respond to incentives and disincentives to change their behaviors, but to date, efforts to incentivize the uptake of CER have had only modest success. This funding opportunity seeks applications that will investigate whether the principles of behavioral economics could enhance the uptake of the results CER among health care providers and thus improve the health of patient populations. …

In the context of this FOA, behavioral economics refers to the interdisciplinary efforts involving cognitive and social psychologists, decision scientists, and other social scientists together with economists to model economic decision-making and consequent actions. The approach is inclusive, since at its heart it tries to take into account what is known about how people actually make decisions rather than relying on the assumption that economic agents are fundamentally rational in the sense of expected utility. As a field, behavioral economics seeks to understand how human social, cognitive, and emotional factors affect economic decisions. It considers the values assigned to all aspects of a choice, including, but not limited to monetary factors. In addition, behavioral economics acknowledges the important role that a specific context (or frame) may have on decisions, and takes into account people’s apparently irrational preferences (e.g., losses count more than gains, an object that is owned is more valuable than the same object that is not owned). For a recent review of behavioral economics from an economic perspective, Dellavigna (2009) is useful; from a psychological standpoint, Kahneman and Tversky (2000) and Kahneman (2003) provide useful data and historical context. There is growing evidence that such approaches may hold more promise than approaches based on either conventional theories of behavior change or neoclassical economics. The application of approaches from behavioral economics to the healthcare field could be valuable in the development of incentives or disincentives to motivate sustainable changes in provider and patient behavior.

It should be noted that the use of conventional economic incentives to affect provider behavior, including the uptake of CER, has been the subject of considerable research. Perhaps most germane to the topic of this FOA is the literature on “pay for performance”, also known as P4P. The logic of P4P is clear: rather than paying physicians or other health care providers (just) for the specific, billable, services they provide (which naturally incentivizes the ordering of more tests and procedures), they should be paid based on patient outcomes or on their achievement of other objective milestones that should be directly related to patient outcomes. In a classical economic context, it would be a puzzle if physicians and other treatment providers did not align their practice with the procedures or guidelines for practice that are incentivized. Strikingly, however, the evidence for the effectiveness of P4P schemes are often quite modest (reviewed by, e.g., Petersen et al., 2006). Although there are explanations in part for some of these incentive failures (e.g., the principal-agent problem), it seems clear that the incentive system could be improved. Further, many behavioral economists would argue that key improvements could be made not only in the design and delivery of incentives but also in the construction of the decision environment for the health care provider.

To date, implementation of behavioral economic approaches to change decision-making and behavior has focused primarily on economic topics such as behavioral finance (but see, e.g., Volpp et al., 2009 for a recent trial involving smoking cessation). The underlying ideas would seem to have much broader applicability. Behavioral economic interventions are generally of two basic types: one can restructure the choice environment, or manipulate the individual’s perceived incentives. One notable example of the former was Choi, Laibson, and Madrian’s (2004) intervention to increase retirement savings participation. By changing the default action to “contribute” they relied on behavioral inertia to maintain that level of participation. This is an example of altering behavior by manipulating the “choice architecture” that confronts individuals in daily life (see also Thaler and Sunstein, 2008). By structuring choice architectures to subvert individuals’ entrenched biases to stick with the status quo and discount future benefits, a well-developed system of so-called asymmetric paternalism (Loewenstein, Brennan, and Volpp, 2007) could provide interesting opportunities to induce change in provider behavior with respect to selecting a comparatively effective treatment while preserving a clinician’s freedom to choose an alternative treatment when the CER-recommended treatment is counter-indicated. One relevant example of the use of a default option approach that has been successfully implemented (albeit not in the context of CER per se) can be seen in places where statute or policy allows generic equivalents to be substituted for brand name drugs by pharmacists unless a physician specifically notes (or checks off a box denoting that) the prescription is to be “dispensed as written” (DAW). Here, the “transaction cost” of over-riding the default is almost zero, but the effect on generic dispensing rates can be quite large. In particular, generic drug utilization rates varied from 37 percent to 83 percent among Medicare Part D plans (Levinson, 2007), and it would appear that some of this variation is attributable to systemic factors that could be manipulated.

In addition to these more passive, environmental manipulations, behavioral economists have explored the manipulation of incentives to alter behavior. There has been particular interest in the use of deposit contracts, lotteries, and other monetary contingencies to effect health-related behavior change (e.g., Volpp et al. 2008). (Also note that some self-imposed commitment devices can be at least modestly effective at nearly zero external cost, e.g., Ariely and Wertenbroch, 2002). The effect of these devices is generally to allow individuals to overcome their own behavioral inertia, or to make continued compliance with recommended courses of action more attractive. Some of these techniques are similar in spirit to P4P, but the design of the incentives can be very different, and reflects what is known by psychologists about people’s preferences, and how those preferences can be manipulated. Like P4P, however, there can be concerns about the efficiency of providing incentives to reward behavior that would occur in any event, and questions concerning the overall cost effectiveness of monetary incentives. Trials supported by this funding opportunity will, of course, have the option to directly compare rates of uptake in incentivized and non-incentivized conditions, potentially leading to estimates of the marginal cost of the incentive.

More information at:
http://grants.nih.gov/grants/guide/rfa-files/RFA-OD-10-001.html

And please, if you get $7,500,000, please consider yourself nudged to donating 10% to Decision Science News.

Photo credit: http://www.flickr.com/photos/nirbhao/2573135240/

December 30, 2009

Bad decade to be a stock

Filed in Ideas
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

AS THE DECADE ENDS, U.S. STOCK MARKETS LOWER THAN WHERE THEY STARTED

S&P 500
Date Adj Close
12/31/2009 1,115
12/31/1999 1,469
DOW JONES
Date Adj Close
12/31/2009 10,428
12/31/1999 11,497
NASDAQ
Date Adj Close
12/31/2009 2,269
12/31/1999 4,069

One can see from the above that the S&P 500 index is down 23% over the decade, the Dow is down 8% and the NASDAQ is down 43%! If we compute CAGRs (Compound Annual “Growth” Rates), we could say the S&P lost about 3% per year, the Dow lost about 1% per year, and the NASDAQ lost about 6% per year. Hooray.

However, it’s likely you didn’t lose as much as these indices did. You probably have money in bonds or bank accounts that didn’t go down. If you held international (sorry, popular non-US) stocks, you probably came out ahead. Also note that looking at just a single window like this gives a biased view (so called end-point bias). If you want to search hard for other reasons to feel good, see this comment on why it wasn’t a lost decade.

Photo credit: http://www.flickr.com/photos/stevendavidjohnson/4141860344/

December 23, 2009

SCP 2010 Conference, St Pete Beach, Florida, Feb 25-27, 2010

Filed in Conferences
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

SOCIETY FOR CONSUMER PSYCHOLOGY ANNUAL WINTER CONFERENCE

Decision Science News will attend the SCP 2010 conference. It’s taking place, as it has in the past, in balmy St. Pete Beach, Florida (think Tampa / St. Petersburg) and is sure to offer a bevy of consumer behavior theories and crossover interactions.

What:  SCP 2010 Conference
Where: Tradewinds Resort
Map: 5500 Gulf Boulevard, St. Pete Beach, FL 33706
When: February 25-27, 2010
Register: http://www.chilleesys.com/scp/conference/special_events.aspx
Early registration fee (members): $375 till Jan 22, 2010
Early registration fee (student, members): $125 till Jan 22, 2010
From the organizers:

The Society for Consumer Psychology (SCP) will be holding its Annual 2010 Winter Conference on February 25-27 at the Tradewinds Island Resort, St. Pete Beach, FL. The SCP conference provides opportunities for a high level of interaction among participants interested in the integration of psychology and consumer research. The 2010 conference will be held in beautiful St. Pete Beach, a short drive from the Tampa/St. Petersburg/Clearwater metropolitan area.

Find more at the SCP 2010 Winter Conference Website

December 17, 2009

How to run experiments on Mechanical Turk

Filed in Encyclopedia ,Ideas ,Research News ,Tools
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

THE TECHNICAL DETAILS, TUTORIALS, WALK-THROUGHS

mrk_guide2

A few posts back, we showed how classic decision making experiments are being replicated on Amazon’s insta-subject-pool otherwise know as Mechanical Turk (aka MT).

After that, Steven Pinker, at the SJDM keynote, presented Mechanical-Turk-collected data on perceptions of whether the past or present is perceived as more violent.

This week, Decision News News, currently stationed at Yahoo! Research in New York, points to a useful guide to running experiments on MT, written by fellow Yahoo researcher and all-around wizard of computational psychology, Winter Mason.

If you want to do some very basic experiments using MT, you can probably get started using their templates. However, if you want to have participants engage in more complex interactive tasks, you probably want to use their command line tools or API. Here’s a guide to help you decide. If you go the command-line route, Winter’s instructions will save you some of the pain of figuring it out for yourself.

Here at Yahoo, we’ve been able to do some amazing MT experiments, including group decision making tasks, in which the groups are assembled on the fly. Think of it, no more inviting people to the lab and having to cancel when too few show up.

Photo credit: http://en.wikipedia.org/wiki/File:Tuerkischer_schachspieler_windisch4.jpg

December 11, 2009

Martin Fishbein 1936 – 2009

Filed in Encyclopedia
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

PROFILE OF A PIONEER IN SOCIAL PSYCHOLOGY

mf2

Decision Science News has learned that the creator of expectancy-value theory, Martin Fishbein, has died.

From Icek Aizen:

We report with great sadness that our friend and colleague, Martin Fishbein, died Friday, November 27 of a heart attack while on a visit to London. Marty was a professor at the University of Illinois — Champaign/Urbana from 1961 to 1997 and since then has been the Harry C. Coles, Jr. Distinguished Professor of Communication at the Annenberg School for Communication and founding director of the Health Communication division of the Annenberg Public Policy Center.

Marty’s research interests included attitude theory and measurement, communication and persuasion, behavioral prediction and change, and behaviors in field and laboratory settings, including studies of the effectiveness of health-related behavior change interventions. He was president of both the Society for Consumer Psychology and the Interamerican Psychological Society and won many awards, including a Guggenheim Fellowship.

Marty is perhaps best known for his landmark theories in the field of social psychology. Working with his former student Icek Ajzen, he expanded his expectancy-value model into the theory of reasoned action, a theory that has had a marked impact not only on attitude research but also on applied work in such fields as health psychology, environmental behavior, marketing, organizational communication, and consumer behavior. His work is reviewed in a just published monograph: Fishbein, M., & Ajzen, I. (2010). Predicting and changing behavior: The reasoned action approach. New York: Psychology Press (Taylor & Francis).

Information about a celebration of his life will follow when plans for the event are finalized.

Icek Aizen
University of Massachusetts

For those wishing to learn more on Fishbein’s work see

December 1, 2009

A simple heuristic to forecast elections

Filed in Research News
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

PREDICTING ELECTIONS FROM THE MOST IMPORTANT ISSUE FACING THE COUNTRY

Ele5

Andreas Graefe and Scott Armstrong have put forth a model that predicts the outcome of U.S. Presidential Elections based on the most important issue as seen by voters. It’s a good illustration of how one cue, if it’s a good one, can be effective for forecasting.

It’s an early draft and they would appreciate comments.

The paper is available here: http://pollyvote.forecastingprinciples.com/images/papers/PollyMIP.pdf

Photo credit: http://en.wikipedia.org/wiki/File:Election_MG_3455.jpg

November 25, 2009

Boulder financial decision making conference, abstracts due Dec 15, 2009

Filed in Conferences ,SJDM ,SJDM-Conferences
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

FIRST ANNUAL BOULDER SUMMER CONFERENCE ON CONSUMERS’ FINANCIAL DECISION MAKING

bolfla

What: First Annual Boulder Summer Conference on Consumers’ Financial Decision Making
When: June 27-29, 2010
Where: Hotel Boulderado, Boulder, Colorado
Deadline: Abstract SubmissionDecember 15, 2009

Decision Science News was at the Leeds School of Business at the University of Colorado in Boulder last week, had a great time, and thinks they have a great group there with strong expertise and interest in Judgment and Decision Making research, particularly as it concerns consumers’ financial decision making. Fittingly, they are about the launch the first in a set of annual conferences on the topic. Decision Science News intends to be in attendance. Here’s the information, provided by John Lynch:

Submitting Abstracts

To submit an extended abstract (1 to 2 pages), please visit the conference website: http://Leeds.Colorado.Edu/BoulderSummerConference and click on the Paper Abstract Submission link.

Submission Deadline for Extended Abstract: December 15, 2009

Conference Overview

The conference will provide a forum for exchange of ideas among researchers in different fields working on problems of consumer financial decision-making. Consumer welfare is strongly affected by household financial decisions large and small: choosing mortgages; saving to fund college education or retirement; using credit cards to fund current consumption; choosing how to “decumulate” savings in retirement; deciding how to pay for health care and insurance; and investing in the stock market. Basic research in judgment and decision making, psychology, consumer research, behavioral finance, and behavioral economics can inform our understanding of how consumers actually make such decisions and how consumers can be helped to make better decisions by innovations in public policy, business, and consumer education.

Conference Format

Papers will be presented in two forums: a poster session the first night of the conference and in a series of 75-minute sessions. Ten such sessions over the two days of the conference will each have two paper presenters, a discussant, and time for audience questions and comments.

The conference co-chairs will select papers for presentation at the conference based on extended abstracts. Selected papers must not be published prior to the conference, but those researchers presenting their work at the conference must have a paper that is complete and available for review by discussants one month prior to the conference. Selections will be based on quality, relevance to consumers’ financial decision-making, and contribution to breadth of topics and disciplinary approaches across the conference as a whole.

Registering for the Conference and Booking a Room

There are links on the conference website for booking at the Boulderado and for registering for the conference.

The conference will be held in the historic Hotel Bouderado. We have negotiated very attractive room rates for conference attendees (and families). Please note that the Conference has not guaranteed any rooms, rather they are on a “first come” basis. We encourage you to book your rooms as soon as you can. Boulder is a popular summer destination and rooms go quickly at the Hotel Boulderado!

Photo credit: http://en.wikipedia.org/wiki/File:Flatirons_Winter_Sunrise_edit_2.jpg

November 16, 2009

Amazon’s Mechanical Turk meets classic JDM experiments

Filed in Ideas ,Research News ,SJDM ,Tools
Subscribe to Decision Science News by Email (one email per week, easy unsubscribe)

A WHOLE NEW WORLD OF EXPERIMENTS NOW POSSIBLE

mrk

Gabriele Paolacci sends along the following announcement. Decision Science News is also a fan of Amazon’s Mechanical Turk (or mturk as we insiders call it), and it and its colleagues at Yahoo! Research are actively using with the evolving methodology.

You are probably aware of the growing interest for Amazon’s Mechanical Turk (AMT) as a tool for conducting experimental research in the web. By allowing to allocate tasks to paid subjects, Mechanical turk is an online labor market where subjects can be recruited and paid on a large scale and in short time. Being an online labor market, it also is a potentially interesting “ecologically valid” context for experiments: subjects are looking for “real” jobs when they decide to participate to an experiment.

While the potential for using AMT in experiments is huge, there are obvious issues of validating its reliability. In this spirit, hoping to provide a service to the experimental community, Massimo Warglien and me started a blog. In this blog we are sharing our first attempts to replicate classical lab experiments in AMT and compare the outcomes with the original ones. As replications cumulate, we hope to be able to provide in the future more sophisticated meta-analyses of the results.

Please give a look at the blog if you are curious: http://experimentalturk.wordpress.com/

We invite you to share this information with anyone that might be interested. In particular, we invite to send us other replication exercises that might be performed to enrich the data set of replications and broaden the empirical basis of the validation effort. Other kind of experimental or survey experiences or useful tools to improve experimentation in the web via crowd-sourcing resources such as AMT are welcome as well; useful links are also gratefully received.

Among other things, AMT might provide a great tool for having students implement simple and cheap experimental projects during courses on experimental methods and results. Replication studies could be great projects for students and could help to quickly implement a large data set of comparative nature with other experimental settings such as the traditional lab.

Hope you like the blog. If anyone is interested, I will be available to talk more about this at the SJDM conference.

If you want to learn about the original mechanical turk, then it’s Wikipedia to the rescue.