mlr3resampling

Resampling Algorithms for 'mlr3' Framework

CRAN Package

A supervised learning algorithm inputs a train set, and outputs a prediction function, which can be used on a test set. If each data point belongs to a group (such as geographic region, year, etc), then how do we know if it is possible to train on one group, and predict accurately on another group? Cross-validation can be used to determine the extent to which this is possible, by first assigning fold IDs from 1 to K to all data (possibly using stratification, usually by group and label). Then we loop over test sets (group/fold combinations), train sets (same group, other groups, all groups), and compute test/prediction accuracy for each combination. Comparing test/prediction accuracy between same and other, we can determine the extent to which it is possible (perfect if same/other have similar test accuracy for each group; other is usually somewhat less accurate than same; other can be just as bad as featureless baseline when the groups have different patterns). For more information, https://tdhock.github.io/blog/2023/R-gen-new-subsets/ describes the method in depth. How many train samples are required to get accurate predictions on a test set? Cross-validation can be used to answer this question, with variable size train sets.

  • Version2024.9.6
  • R versionunknown
  • LicenseGPL-3
  • Needs compilation?No
  • Last release09/11/2024

Documentation


Team


Insights

Last 30 days

This package has been downloaded 269 times in the last 30 days. Enough downloads to make a small wave in the niche community. The curiosity is spreading! The following heatmap shows the distribution of downloads per day. Yesterday, it was downloaded 6 times.

Sun
Mon
Tue
Wed
Thu
Fri
Sat
0 downloadsDec 8, 2024
0 downloadsDec 9, 2024
0 downloadsDec 10, 2024
0 downloadsDec 11, 2024
0 downloadsDec 12, 2024
0 downloadsDec 13, 2024
15 downloadsDec 14, 2024
5 downloadsDec 15, 2024
7 downloadsDec 16, 2024
4 downloadsDec 17, 2024
9 downloadsDec 18, 2024
19 downloadsDec 19, 2024
7 downloadsDec 20, 2024
7 downloadsDec 21, 2024
9 downloadsDec 22, 2024
6 downloadsDec 23, 2024
7 downloadsDec 24, 2024
18 downloadsDec 25, 2024
4 downloadsDec 26, 2024
7 downloadsDec 27, 2024
6 downloadsDec 28, 2024
4 downloadsDec 29, 2024
4 downloadsDec 30, 2024
7 downloadsDec 31, 2024
22 downloadsJan 1, 2025
12 downloadsJan 2, 2025
18 downloadsJan 3, 2025
14 downloadsJan 4, 2025
6 downloadsJan 5, 2025
9 downloadsJan 6, 2025
5 downloadsJan 7, 2025
16 downloadsJan 8, 2025
4 downloadsJan 9, 2025
9 downloadsJan 10, 2025
3 downloadsJan 11, 2025
6 downloadsJan 12, 2025
0 downloadsJan 13, 2025
0 downloadsJan 14, 2025
0 downloadsJan 15, 2025
0 downloadsJan 16, 2025
0 downloadsJan 17, 2025
0 downloadsJan 18, 2025
3
22

Last 365 days

This package has been downloaded 3,774 times in the last 365 days. Consider this 'mid-tier influencer' status—if it were a TikTok, it would get a nod from nieces and nephews. The day with the most downloads was Jan 24, 2024 with 84 downloads.

The following line graph shows the downloads per day. You can hover over the graph to see the exact number of downloads per day.

Data provided by CRAN


Binaries


Dependencies

  • Imports5 packages
  • Suggests11 packages