'Open Scoring' API Client.

Open Scoring API Client for R

Creativity research involves the need to score open-ended problems. Usually done by humans, automatic scoring using AI becomes more and more accurate. This package provides a simple interface to the ‘Open Scoring’ API, leading creativity scoring technology by Organiscak et al. (2023). With it, you can score your own data directly from an R script.

Installation

Install the released version of openscoring from CRAN with:

install.packages("openscoring")

You can install the development version of openscoring from GitHub with:

# install.packages("devtools")
devtools::install_github("jakub-jedrusiak/openscoring")

Example

library(openscoring)

df <- tibble::tibble(
  stimulus = c("brick", "hammer", "sponge"),
  response = c("butter for trolls", "make Thor jealous", "make it play in a kids show")
)

df
#> # A tibble: 3 × 2
#>   stimulus response                   
#>   <chr>    <chr>                      
#> 1 brick    butter for trolls          
#> 2 hammer   make Thor jealous          
#> 3 sponge   make it play in a kids show

scored_df <- oscai(df, stimulus, response, model = "chatgpt2")

scored_df
#> # A tibble: 3 × 3
#>   stimulus response                    .originality
#>   <chr>    <chr>                              <dbl>
#> 1 brick    butter for trolls                    3  
#> 2 hammer   make Thor jealous                    3.5
#> 3 sponge   make it play in a kids show          3.6

The "1.5" model works for multiple languages:

df_polish <- tibble::tibble(
 stimulus = c("cegła", "młotek", "gąbka"),
  response = c("masło dla trolli", "wywoływanie zazdrości u Thora", "postać w programie dla dzieci")
)

oscai(df_polish, stimulus, response, model = "1.5", language = "Polish")
#> # A tibble: 3 × 3
#>   stimulus response                      .originality
#>   <chr>    <chr>                                <dbl>
#> 1 cegła    masło dla trolli                       2.3
#> 2 młotek   wywoływanie zazdrości u Thora          3.7
#> 3 gąbka    postać w programie dla dzieci          2.3