Personality Tests


A statistical comparison of the OEJTS with other on-line tests

Summary

A comparative validity study of the Open Extended Jungian Type Scales was done using three other on-line tests that measured the same construct (Myers-Briggs Type Indicator alternatives). On the OEJTS website, at the end of the test, users were asked to volunteer to take a test on a remote website and report their results. Users were also asked to report their Myers-Briggs type if they knew it. From this data, the quality of the four different tests was assessed based on power to differentiate between self-reported types. The ability of the OEJTS to differentiate among individuals of known type was significantly higher than other tests. This is good evidence for the OEJTS being the most accurate on-line Myers-Briggs/Jungian type test.



Contents
  1. Introduction
  2. Methods
  3. Statistical type differentiation power
  4. Inter-scale correlations
  5. Data

Introduction

The Myers-Briggs types (also known as Jungian types) is one of the most popular personality systems. The Open Extended Jungian Type Scales is an open source measure of the types and was developed by selecting items that differentiated among individuals of known type. A good item should significant response differences between individuals on the dichotomy it is meant to measure and little or no response differences between individuals on the other dichotomies. Likewise for scale scores. For example, a good Introversion-Extroversion scale should show a large effect size between groups of self-identified introverts (Ixxx) and extroverts (Exxx) and little difference between groups of self-identified thinkers (xxTx) and feelers (xxFx), as so forth.

Methods

The data was collected on the website of the OEJTS. After individuals completed the EOJTS they were asked if they knew their Myers-Briggs type already, and if so what it was. Then, they were asked if they would be willing to complete another optional survey. Those who did not were sent directly to their results. Those who did were instructed to open a test on a different website in a different tab, complete it, and then record their results in the survey. This was done in three separate phases, one for each remote test to be compared.

There are innumerable on-line Myers-Briggs tests, only three were chosen due to limits on subjects. The three were chosen on the basis of their judged popularity within Myers-Briggs enthusiast communities. The three chosen were the HumanMetrics Jung Typology Test, SimilarMinds Jung Personality Test and 16Personalities personality test.

With the data, for each scale, its ability to differentiate in among individuals of self-identified types will be calculated it terms of effect size for each dichotomy. Effect size reflect how different the scores of two groups are. Effect size will be calculated here as (group_mean_a - group_mean_b)/(0.5 * standard_deviation_group_a + 0.5 * standard_deviation_group_b).

Statistical type differentiation power

The main measure of sale quality used here is effect size for scale scores between individuals of known types. The table below shows the effect size for score differences on the separate scales by dichotomy in individuals of self-identified type. Values greater than 2 are shaded orange, values greater than 1 are yellow and values greater than 0.5 are pink.

(click to sort)
Scale I-E S-N F-T J-P
OEJTS-IE 2.0616111146 0.0706240984 0.2996595204 0.1699302751
OEJTS-SN 0.1093823257 0.9313485108 0.1054521542 0.0945317865
OEJTS-FT 0.0662743608 0.0104194982 1.6277546211 0.0077469537
OEJTS-JP 0.0942607164 0.1413289981 0.2130392641 1.3046562547
SimilarMinds-IE 0.9074564774 0.3115467924 0.1620119945 0.2851872411
SimilarMinds-SN 0.0250650518 0.6482018398 0.1599996311 0.1384789322
SimilarMinds-FT 0.0182739769 0.1689985059 0.7334673708 0.1187324685
SimilarMinds-JP 0.0702535561 0.2796038331 0.0449126946 0.9476855841
HumanMetrics-IE 1.5115849292 0.269998581 0.2423827983 0.1807170013
HumanMetrics-SN 0.1749302244 0.943459433 0.1285683587 0.1073635002
HumanMetrics-FT 0.1246224717 0.0608562702 1.1847784146 0.1969780629
HumanMetrics-JP 0.1127447017 0.0078607744 0.1780011082 1.0743118098
16Personalities-IE 1.3993117692 0.0471526438 0.1156533743 0.1459637258
16Personalities-SN 0.0266282762 0.8532798819 0.0920949717 0.0125013561
16Personalities-FT 0.1371480995 0.018952246 1.1210326111 0.3566323292
16Personalities-JP 0.0614761565 0.4157405253 0.173212872 1.0180326794

Inter-scale correlations

To compare the content of the tests, the correlations between each scale in the three comparison samples were to computed.

OEJTS and SimilarMinds (n=996)
OEJTS SimilarMinds
IE1SN1FT1JP1IE2SN2FT2JP2
IE10.04-0.1-0.01-0.47-0.14-0.07-0.07
SN1-0.040.130.03-0.390.1-0.15
FT1-0.070.1-0.10.440.14
JP10.06-0.19-0.04-0.54
IE20.090.060.03
SN2-0.130.36
FT20.12
JP2

OEJTS and HumanMetrics (n=1076)
OEJTS HumanMetrics
IE1SN1FT1JP1IE2SN2FT2JP2
IE1-0.02-0.11-0.1-0.610.1-0.15-0.05
SN1-0.130.190.11-0.42-0.05-0.13
FT1-0.140.11-0.060.60.16
JP10.04-0.02-0.07-0.53
IE2-0.330.150.14
SN20.01-0.03
FT20.12
JP2

OEJTS and 16Personalities (n=449)
OEJTS 16Personalities
IE1SN1FT1JP1IE2SN2FT2JP2
IE1-0.07-0.1-0.09-0.58-0.06-0.03-0.08
SN1-0.020.150.010.380.04-0.06
FT1-0.10.11-0.020.580.21
JP10.070.24-0.05-0.53
IE20.16-0.050.01
SN2-0.01-0.18
FT20.23

Discussion

By the metric chose to be used here, the OEJTS is a clearly superior test. Its relevant scales have 25-40% more differentiating power than the next best scales on the IE, FT, and JP dichotomies, and has about equal differentiating power to its best competitors on the SN scale.

Data

All data used in this article can be downloaded here. Each file contains a codebook and dataset.
  • SimilarMinds-comparison-data.zip
  • HumanMetrics-comparison-data.zip