Card explaining why research findings do not transfer between workspaces. Which workspace lessons fail to transfer to your own desk?
Image: Quiet Desk Keys

Maintenance

Part of Real published field research beats an invented workspace case study

Which workspace lessons fail to transfer to your own desk?

Lifting a number out of a study is the most common error. What transfers between settings, what does not, and how to tell the difference quickly.

Research is useful and it is easy to misuse. The errors below are the ones that turn a good study into a bad decision, and each has a quick test that catches it.

What to take away

  • Numbers do not transfer between buildings. Methods do.
  • A finding from a different climate, culture or building type is a hypothesis for you, not a result.
  • Prior experience changes outcomes, which is why two people report differently from the same change.
  • Read the limitations section. It is short and it is where the authors tell you what not to do with their work.

Mistake one: lifting the number

A measured level in someone else's office describes their room, their instrument and their day. Borrow the approach and measure your own. This is the single most common error and the easiest to avoid.

Mistake two: ignoring the setting

A soundscape study at a Taoist temple in Chongqing used field measurements, interviews, soundwalks and audio-visual experiments. It found a significant negative relationship between the measured five minute equivalent level and reported soundscape comfort, plus effects from what people could see.

The general link between level and comfort travels, but the specific values and visual context belong to that site.

Mistake three: forgetting that experience changes the outcome

A cross-sectional study of 934 workers in the Brazilian labor judiciary during the pandemic found that previous experience of teleworking was associated with a better evaluation of the home workstation. It found a smaller workload increase.

Two people can make the same change to the same room and report different results because prior familiarity is one of the strongest moderators.

Mistake four: treating a positive finding as a recommendation

Most studies report an association under stated conditions, but not advice to buy; marketing lives in that gap.

A finding that people in treated rooms reported less annoyance is not an instruction to buy panels. It says nothing about how much treatment, at what cost, or whether the same people would report the same after any visible room change.

Mistake five: skipping the limitations

What you readWhat to check
A large effectSample size and whether it was randomised
A precise numberThe measurement conditions
A confident conclusionWhether the authors hedge it in the limitations
A single siteWhether anyone has replicated it

A quick test before borrowing anything

Ask three questions: Is the building like mine, are the people like me, and was the thing measured the thing I care about? If any answer is no, take the method and drop the number.

Borrow Method Or Number?

Is the building like mine?

Yes

keep going

No

take the method, drop the number

General process errors alongside it are in the mistakes that waste the most time. The case for reading research at all is in published field studies worth reading.

Common questions

Is a study from another country useless to me?
No. Climate, housing and culture change the numbers. The measurement approach and the questions asked usually transfer intact.
How do I judge sample size?
Roughly. Under twenty people in a laboratory study is normal and limits confidence. A survey of a few hundred is more persuasive about prevalence than about cause.
What if two studies disagree?
That is common and informative. Read what differed in the methods, because the disagreement is usually there rather than in the phenomenon.
Should I read the whole paper?
The abstract, the method and the limitations. That is usually enough to decide whether anything in it applies to you.

More in Maintenance

Latest from Keyboards Desk