How teachers influence student adoption and effectiveness of a recommendation system for Algebra<\/strong><\/h2>\nAdvanced learning technologies (ALT) have become increasingly available to teachers for classroom use. Research has suggested that many factors can influence teacher adoption and fidelity of use of ALT in the classroom, including teacher beliefs, knowledge and experience, technological factors, and instructional factors. However, there has been scarce research linking teacher factors to student adoption of ALTs. This study examined the relationships\\ between teacher characteristics and practices and student adoption and learning gains with a video recommendation system embedded within a virtual learning environment (VLE) for Algebra. Secondary data was obtained from an experimental study conducted over one academic semester in middle and high schools in a southeastern state of the United States. The sample included 52 teachers and 2936 students. The data included teacher responses to three surveys, and student demographic and achievement variables. A random forest was used to predict the rate that the students followed video recommendations in the VLE.<\/p>\n
The results show that the recommendation followed rate is related to the teachers\u2019 fidelity of use, frequency of student monitoring, and experience with the VLE. Most of the survey items specifically evaluating teachers\u2019 beliefs about the recommender were important predictors of students\u2019 following video recommendations. Teacher monitoring through a dashboard was the most important predictor. The analysis of treatment effect heterogeneity of the video recommendation system was performed using the generic machine learning inference (GenericML) method paired with random forests. Results show that teachers of students who benefitted most reported spending more time using the videos of the VLE and following student progress through the dashboard, but less time on the VLE than teachers of students who benefit the least. Teachers of students who benefitted the least had larger classrooms, struggled more with the challenges due to the Covid-19 pandemic, and spent less time with classroom planning. The results support the recommendation that teacher professional development for ALT should engage groups of educators in increasing their experience with the application so that they build comfort and confidence in its use in ways in which students are most likely to benefit.<\/p>\n
[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":21,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[5],"tags":[],"class_list":["post-3862","post","type-post","status-publish","format-standard","hentry","category-research"],"yoast_head":"\n
Research Results Shared at the Learning @ Scale Conference in Copenhagen - Research Evaluation and Methodology<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Research Results Shared at the Learning @ Scale Conference in Copenhagen\" \/>\n<meta property=\"og:url\" content=\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/\" \/>\n<meta property=\"og:site_name\" content=\"Research Evaluation and Methodology\" \/>\n<meta property=\"article:published_time\" content=\"2025-04-09T15:39:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-08T13:49:35+00:00\" \/>\n<meta name=\"author\" content=\"evekung\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"evekung\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/\",\"url\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/\",\"name\":\"Research Results Shared at the Learning @ Scale Conference in Copenhagen - Research Evaluation and Methodology\",\"isPartOf\":{\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/#website\"},\"datePublished\":\"2025-04-09T15:39:44+00:00\",\"dateModified\":\"2026-04-08T13:49:35+00:00\",\"author\":{\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/#\/schema\/person\/1b5bc7fcb1ba88dfb70388bac7a463ca\"},\"breadcrumb\":{\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"RESEARCH AND EVALUATION METHODOLOGY\",\"item\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research Results Shared at the Learning @ Scale Conference in Copenhagen\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/#website\",\"url\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/\",\"name\":\"Research Evaluation and Methodology\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/#\/schema\/person\/1b5bc7fcb1ba88dfb70388bac7a463ca\",\"name\":\"evekung\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/92828e84f68a4ba3183231e45520c40e23f0a642378f394c14fc16f8fd6b30b0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/92828e84f68a4ba3183231e45520c40e23f0a642378f394c14fc16f8fd6b30b0?s=96&d=mm&r=g\",\"caption\":\"evekung\"},\"url\":\"https:\/\/education.ufl.edu\/research-evaluation-methods\/author\/evejung\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Research Results Shared at the Learning @ Scale Conference in Copenhagen - Research Evaluation and Methodology","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/","og_locale":"en_US","og_type":"article","og_title":"Research Results Shared at the Learning @ Scale Conference in Copenhagen","og_url":"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/","og_site_name":"Research Evaluation and Methodology","article_published_time":"2025-04-09T15:39:44+00:00","article_modified_time":"2026-04-08T13:49:35+00:00","author":"evekung","twitter_card":"summary_large_image","twitter_misc":{"Written by":"evekung","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/","url":"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/","name":"Research Results Shared at the Learning @ Scale Conference in Copenhagen - Research Evaluation and Methodology","isPartOf":{"@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/#website"},"datePublished":"2025-04-09T15:39:44+00:00","dateModified":"2026-04-08T13:49:35+00:00","author":{"@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/#\/schema\/person\/1b5bc7fcb1ba88dfb70388bac7a463ca"},"breadcrumb":{"@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/2025\/04\/09\/research-results-shared-at-the-learning-scale-conference-in-copenhagen\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"RESEARCH AND EVALUATION METHODOLOGY","item":"https:\/\/education.ufl.edu\/research-evaluation-methods\/"},{"@type":"ListItem","position":2,"name":"Research Results Shared at the Learning @ Scale Conference in Copenhagen"}]},{"@type":"WebSite","@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/#website","url":"https:\/\/education.ufl.edu\/research-evaluation-methods\/","name":"Research Evaluation and Methodology","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/education.ufl.edu\/research-evaluation-methods\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/#\/schema\/person\/1b5bc7fcb1ba88dfb70388bac7a463ca","name":"evekung","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/education.ufl.edu\/research-evaluation-methods\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/92828e84f68a4ba3183231e45520c40e23f0a642378f394c14fc16f8fd6b30b0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/92828e84f68a4ba3183231e45520c40e23f0a642378f394c14fc16f8fd6b30b0?s=96&d=mm&r=g","caption":"evekung"},"url":"https:\/\/education.ufl.edu\/research-evaluation-methods\/author\/evejung\/"}]}},"_links":{"self":[{"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/posts\/3862","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/comments?post=3862"}],"version-history":[{"count":3,"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/posts\/3862\/revisions"}],"predecessor-version":[{"id":4811,"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/posts\/3862\/revisions\/4811"}],"wp:attachment":[{"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/media?parent=3862"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/categories?post=3862"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/education.ufl.edu\/research-evaluation-methods\/wp-json\/wp\/v2\/tags?post=3862"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}