A troubled tale

    As an individual on the spectrum, I find it sometimes challenging to believe the employment I have secured is reliable given that coworkers have been known, on occasion, or when they are in a mood and I am insufficient to respond, to perceive I am hostile, uncaring, or emotionally withdrawn. In-person 8am interviews with panels of neurotypical individuals with high social skills and high social interactivity requirements are not the best time or place for the neurodiverse worker to shine. There is a reason we have earned the moniker 'robot'.

So, when I read a thread on Hacker News about a New York based company that publicly claimed a 75% neurodiverse workforce and an atypical hiring process designed to eliminate interviewer bias and allow selecting the best skilled candidates to join their team, I was enthused. Their QA testing position in specific seemed to be a job that would pay quite a reasonable wage for the hours involved and would never require meeting anyone face to face, period. They maintained that they trained applicants and had a one week ramp-on system to get the prospective employee familiarized with their business and work. An introvert's dream!

I put in an application using their questionnaire form  and waited, received and replied to correspondence, and finally was offered an opportunity to continue the application process by taking a written test via email. I was offered a selection of timeslots to take the test in, and at the designated time, received a subsequent email with instructions and content.

In due time I completed the assignment according to my ability and my understanding of the instructions and returned it. Several days later I was informed that I had failed the assessment. I was beyond incredulous that this was the outcome given the diligence I had applied and the relative experience I believed myself to have with the subject material. Subsequently, having reviewed their diversity program results, and having given a little thought to the plausible models for the statistics of having 75% employees on the spectrum juxtaposed with 45% fairer gender retention, and observing their apparent intended fortune 500 clientele, peevishly, I felt there was some possibility that there might be ulterior motives in utilizing an objective test to establish a legal precedent for applicant rejection where the employer can arbitrarily choose to waive the results for individuals which possess desired organization image enhancing traits and choose to enforce them on entire classes of individuals they do not want to hire.

I was obviously a bit chafed. So, I issued them an cheeky ultimatum which I considered fair. They had three business days to provide me with my score, the score possible on their evaluation, a yes/no answer as to whether the individuals involved with evaluating tests are not native English speakers(not at all unlikely they outsource some HR tasks), and, were my test score within their acceptable margins, the real reason they had rejected me as an applicant. The consequence for failure was that I would, after censoring names and email addresses, take the emails, the test material, my answers, and write up a submission to ycombinator and slashdot.org to get an unbaised and fair assessment from ask my fellow techies what they feel my score was out of the possible scores observable. After all, this is supposed to be an objective test and I would like to feel my rejection was justly deserved given the objective nature of the hiring program. A little bit of sunshine on this situation would also be pretty nice if other people chime in saying they had a similar experience with this employer.

They responded to this challenge with the statement their hiring manager and vice president would get back to me, but it is now end of business on the third day and they have not risen from the tomb. Without further ado, I present to you a select set of the emails in the chain from first to last, not including their email informing me I had failed the objective assessment, the photographic test materials, my test results, and I ask you to judge my job application effort yourself, if you are so willing, and assign me a score.  I am not asking you to decide whether or not the potential employer should have rejected my answers or found them sufficient. I'm just looking for a second opinion.

----
Sent: Sunday, December 8, 2019 6:47:39 AM
To:
Subject: ULTRA Scheduling Test


Dear Candidate,

Thank you for your interest in ULTRA Testing and for completing the Software Tester Application. We would like to invite you to the next step in The Recruitment Process, which is a written test sent to your home computer. The test is not an online test. It involves looking at images sent as attachments in an email. 

The test includes:

Comparing multiple pairs of images from select webpages
Writing a list of discrepancies you find between the images
Emailing the list of discrepancies back to the ULTRA Testing Recruitment Team, preferably in Microsoft Word, if available 

The test is timed. The time starts when you receive the email with the assignment and ends when you send an email back with your list. 

If you are interested in taking the test, please provide a start time from the choices listed below. Choose a time when you'll be at your computer and have up to two hours available.

We can send the assignment at one of these times (NOTE: all times are in EST):
Tuesday, Dec. 10th: 11:00 a.m., 11:30 a.m., 12:00 p.m., 12:30 p.m., or 1:00 p.m. EST
Wednesday, Dec. 11th: 2:30 p.m. EST
Thursday, Dec. 12th: 10:00 a.m., 10:30 a.m., 12:00 p.m., 12:30 p.m., 1:00 p.m., 1:30 p.m. EST


Most applicants take between one and two hours to complete the test. Accuracy is more important than speed. 

If these times don't work, let us know, and we can schedule for a further day out.

Best wishes,
The ULTRA Testing Recruitment Team 
----

Please assign me to begin the test procedure at 1 PM on tuesday, december 10th. Sincerely

Sincerely yours
----
Subject: Fwd: ULTRA Testing Assignment
Dear firstname,


I hope this email finds you well. Per our earlier email exchange, here is your Test.
WRITTEN TEST INSTRUCTIONS
The Test includes eight different images:
                        • Four attached images are of the ‘spec’ pages (what pages should look like)
                                                • Four attached images are of website or ‘site’ pages (what pages look like to an online viewer)
                                                  Your assignment is to compare each of the four spec pages to each of the four site pages, (i.e., spec one to site one, spec two to site two, etc.), and to list the errors/discrepancies you find.  Keep in mind most applicants finish between one and two hours. Remember accuracy is more important than speed.
                                                  Here is an example:
                                                  Spec 1, Site 1
                                                                        • The phone number in upper right corner should read: .1-800-555-5556
                                                                          AFTER THE TEST INSTRUCTIONS
                                                                          1. List atop or in a corner of your test using Google Doc or Word Document (NOT PDF): your first name, last name, date, and ULTRA Test.
                                                                          2. Save your document as [your first and last name] ULTRA Test.
                                                                          3. As soon as you are done: Email your list back as an attached document.
                                                                          If you have any questions, feel free to contact me.
                                                                          Best wishes,



                                                                          Next Step:
                                                                          We use an objective measure to score the test and are looking for certain specifics. If you do well on the assignment, I will send the ULTRA Testing Recruitment Process to you, a detailed document about the next steps in the hiring process. If you do not receive a passing score, I will send you an email thanking you for your participation in the hiring process.

                                                                          ----

                                                                          I hope my list format is acceptable. Sincerely.

                                                                          ----
                                                                          Attachment: Docx:
                                                                          Contents:
                                                                          Firstname Lastname 12/10/19 ULTRA Test.

                                                                          Specification Vs Site 1:
                                                                          · Specification: the “Call Us” number in the upper right should start with 1-800,
                                                                          o the site “Call Us” incorrectly starts with 1-866.
                                                                          · Specification: the “Buy Now” button, located at the lower right of the 50% off product sale section, should have a background color gradient which resembles a Ricola® Orange lozenge with white opaque text and a white border.
                                                                          o the site “Buy Now” background gradient resembles a Hall’s® Cherry lozenge with a translucent text, no border, and a foreground shadow applied to the button.
                                                                          · Specification: The placement of the two “Shop Now” sections in the center of the page calls for the toaster and pink “Shop Now” text on the left, and the knife and blue “Shop Now” on the right.
                                                                          o The site has reversed the sections placements.
                                                                          · Specification: The subtitle “Quality Product” on the left-most list item, “Product”, in the row in the third half of the page, occupies one line.
                                                                          o The site “Quality Product” has a line break in the middle of the text.
                                                                          · The specification left footer entry containing “About Kitchen Store” begins with a copywrite symbol.
                                                                          o The site copywrite symbol is absent.

                                                                          Specification Vs Site 2:
                                                                          · The specification sales item in the center column, first row, “Product 2”, is marked as having a price of $9.99 reduced from an original price of $9.99.
                                                                          o The site original price text indicates the original price was $119.99.
                                                                          · The specification sales item in the first column, second row, “Product 4”, is marked as having a price of $9.99 reduced from an original price of $9.99.
                                                                          o The site original price is absent and the reduced price displayed is $99.99
                                                                          · The specification sales item in the first column, third row, “Product 3”, has a display photo overlayed with a narrow green diagonal strip in the upper left corner of the photograph labeled with text in white which reads “Classic”.
                                                                          o The site overlay stripe is missing along with the text.
                                                                          · The specification sales item in the third column, second row, “Product 6”, is marked as having a price of $99.00.
                                                                          o The site price is marked as $99.99
                                                                          · The specification sales item in the third column, third row, “Product 9”, has a display picture of a set of yellow-tipped short salad tongs.
                                                                          o The sales display picture has a picture of a set of green-tipped long tongs.
                                                                          · The specification navigation selector in the third half of the document, below the sales item listings, has a pair of white triangle on opal circle navigation buttons divided by an indicator showing the current page number and total page count.
                                                                          o The site navigation selector utilizes a pair of black arrows with no background for navigation buttons which are divided by the text “PREV NEXT”.

                                                                          Specification Vs Site 3:
                                                                          · The specification title in the upper left corner of the page, “All About Kitchen” is a bold firm black medium-width font with no underline.
                                                                          o The site title is an italicized narrow-width font with an underline.
                                                                          · The specification menu items on the top center of the page are colored using grey for other site pages and black for the current page, displayed at approximately 40% the size of the specification title font, and are horizontally justified with the specification title.
                                                                          o The site menu items are colored sea-green, bolded, larger than specified, and not justified.
                                                                          · The specified shopping cart footer text starts with “Price in U.S. Dollars:”.
                                                                          o The site footer text reads: “Price in Canadian Dollars:”.
                                                                          · The specification sales item in the first column, first row, is marked “Product 1”.
                                                                          o The site numerical indicator for this item is missing.
                                                                          · The specification sales item in the first column, third row, has a photograph in focus.
                                                                          o The site photograph for this item is not in focus.
                                                                          · The specification display demo is complete with no apparent clipping.
                                                                          o The bottom of the site text lines are clipped and 10% of each character is invisible, making the footer text difficult to read.

                                                                          Specification Vs Site 4:
                                                                          · The specification content in the first third of the page below the site header has a grey(top) to transparent vertical gradient background.
                                                                          o The site content in this section does not have a background.
                                                                          · The specification description field for the first item on the left with the header “Our Philosophy”, contains the word “inventive” among other words.
                                                                          o The site has misspelled inventive with “unventive”.
                                                                          · The specification description field for the first item on the left with the header “Our Philosophy”, contains the phrase “our consumer” among other words.
                                                                          o The site has miscorrectly used hour in place of our.
                                                                          · The specification and Site both potentially contain a grammatical error in the third item description.
                                                                          o The first sentence of the description ends with the preposition “of discover”. This will be grammatically correct if it is referring the to Discover credit card company but is otherwise incorrect, as discover is a verb and verbs are not nouns.
                                                                          · The specification center page content has a green flat background with a thin black border on all sides.
                                                                          o The site content background has a 3d effect applied and a border that does not match the specification.
                                                                          · The specification Facebook icon in the lower right corner of the footer has a blue background.
                                                                          o The site Facebook icon background is green.

                                                                          Please note these photographs are clickable.





                                                                           



                                                                          In each pair of photos depicted, the specification website is on the left and the demonstration is on the right.

                                                                          I recognize a pretty fair number of you are going to say "Well, you didn't provide what was expected" where what you anticipate what was expected was a list of items each delineated by a header line indicating which mockup out of the four it refers to as given in the test instructions email. That's a fair point but I feel my answers are well enough framed and the example answer item was not well enough described as to make that an emphatically important part of the test.

                                                                          In the rejection email the recruiter writes "After review of your test, the hiring team has decided not to move forward with your recruitment for a software tester position. The decision was based on the score of the test. We use a precise rubric and are looking for specific notations of errors and discrepancies, including spelling, pricing, spacing, placement, symbols, borders, shading, images, icons, text placement, line placement, margins, and font style. We take time to review each test carefully, and consider the way the answers were formatted, the language used, precision, and the time taken to complete the test. The test and the evaluation of the test have been developed to address current skillsets required for the company’s software testers.  " Note that this paragraph is located in a part of the email where the font style of the email differs from the first two lines and is indicative of a standard template. 

                                                                          Comments