reactjs - MTurk Sandbox ExternalQuestion Submission

Question

I have a complicated situation, and I am completely at a loss, so I am going to err on the side of providing too many details:

I am using a combination of Python3/Boto3 and a React web server to create a user study which I would like to launch on MTurk as an ExternalQuestion. Specifically, at the moment, I am launching it on Sandbox to pilot test it. This web page basically works, in that it does everything I want and records all the data I want recorded to the machine hosting the web server. But it does not work in terms of the final submission. The very last page of the user study has a button which the user should click to complete their participation. That button is linked to an

const handleClick = async event => {

   const urlParams = new URLSearchParams(window.location.search)
   const form = document.createElement('form')
   form.action = (new URL(' urlParams.get('turkSubmitTo'))).href
   form.method = 'post'

   ...

   form.submit()

What I expect to happen:

1. I expect these to show up as awaiting payment on the requester dashboard

2. I expect these to show up in the boto3 programmatic interface, i.e., something like:

   hit_id = new_hithttps://forums.aws.amazon.com/https://forums.aws.amazon.com/ # new_hit is returned during HIT creation worker_results = mturk.list_assignments_for_hit(HITId=hit_id)

And then worker_results would have an entry for each returned HIT in the Assignments field

What actually happens:

1. This never works. Not once. Not ever.
2. This works intermittently and unpredictably. The server seems to be working just fine, as the user study is lengthy, does not drop out during the study, and the server is professionally maintained. But if I have three people pilot test this (admittedly, sometimes from the same physical laptop (which is not the server) and sometimes not) within an hour of each other, sometimes one HIT shows up, sometimes two, sometimes all three. I don't think it's ever been none. I have instructed my pilot testers to hit the button at the end of the pilot test, and I have verified that they are seeing the green checkmark and 'HIT Submitted successfully' banner at the top of their pages.

So what should I actually see? How does this actually work? I am not changing the server code at all during the group of three pilot tests, so what can be causing this intermittency?

question from:https://stackoverflow.com/questions/65713053/mturk-sandbox-externalquestion-submission

Answer 1

Waitting for answers