Dr. rer. nat. Kathrin Borchert

• Relationship Status: It’s Complicated. Using APM as a QoE-qualifying Tempo Metric. Metzger, Florian; Stulier, Norman; Borchert, Kathrin; Hirth, Matthias. In Proceedings of the 13th International Conference on Quality of Multimedia Experience (QoMEX 2021). 2021.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2021-13, author = {Metzger, Florian and Stulier, Norman and Borchert, Kathrin and Hirth, Matthias}, booktitle = {Proceedings of the 13th International Conference on Quality of Multimedia Experience (QoMEX 2021)}, keywords = {sys:hidden:inproceedings}, month = {06}, title = {Relationship Status: It's Complicated. Using APM as a QoE-qualifying Tempo Metric}, year = 2021 }

  %0 Conference Paper %1 info3-inproceedings-2021-13 %A Metzger, Florian %A Stulier, Norman %A Borchert, Kathrin %A Hirth, Matthias %B Proceedings of the 13th International Conference on Quality of Multimedia Experience (QoMEX 2021) %D 2021 %T Relationship Status: It's Complicated. Using APM as a QoE-qualifying Tempo Metric

• In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE?. Borchert, Kathrin; Seufert, Anika; Gamboa, Edwin; Hirth, Matthias; Hoßfeld, Tobias. In Quality and User Experience. 2020.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  Evaluating the Quality of Experience (QoE) of video streaming and its influence factors has become paramount for streaming providers, as they want to maintain high satisfaction for their customers. In this context, crowdsourced user studies became a valuable tool to evaluate different factors which can affect the perceived user experience on a large scale. In general, most of these crowdsourcing studies either use, what we refer to, as an in vivo or an in vitro interface design. In vivo design means that the study participant has to rate the QoE of a video that is embedded in an application similar to a real streaming service, e.g., YouTube or Netflix. In vitro design refers to a setting, in which the video stream is separated from a specific service and thus, the video plays on a plain background. Although these interface designs vary widely, the results are often compared and generalized. In this work, we use a crowdsourcing study to investigate the influence of three interface design alternatives, an in vitro and two in vivo designs with different levels of interactiveness, on the perceived video QoE. Contrary to our expectations, the results indicate that there is no significant influence of the study’s interface design in general on the video experience. Furthermore, we found that the in vivo design does not reduce the test takers’ attentiveness. However, we observed that participants who interacted with the test interface reported a higher video QoE than other groups.

  @article{info3-article-2020-6, abstract = {Evaluating the Quality of Experience (QoE) of video streaming and its influence factors has become paramount for streaming providers, as they want to maintain high satisfaction for their customers. In this context, crowdsourced user studies became a valuable tool to evaluate different factors which can affect the perceived user experience on a large scale. In general, most of these crowdsourcing studies either use, what we refer to, as an in vivo or an in vitro interface design. In vivo design means that the study participant has to rate the QoE of a video that is embedded in an application similar to a real streaming service, e.g., YouTube or Netflix. In vitro design refers to a setting, in which the video stream is separated from a specific service and thus, the video plays on a plain background. Although these interface designs vary widely, the results are often compared and generalized. In this work, we use a crowdsourcing study to investigate the influence of three interface design alternatives, an in vitro and two in vivo designs with different levels of interactiveness, on the perceived video QoE. Contrary to our expectations, the results indicate that there is no significant influence of the study’s interface design in general on the video experience. Furthermore, we found that the in vivo design does not reduce the test takers’ attentiveness. However, we observed that participants who interacted with the test interface reported a higher video QoE than other groups.}, author = {Borchert, Kathrin and Seufert, Anika and Gamboa, Edwin and Hirth, Matthias and Hoßfeld, Tobias}, journal = {Quality and User Experience}, keywords = {ua-net}, month = 11, title = {In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE?}, year = 2020 }

  %0 Journal Article %1 info3-article-2020-6 %A Borchert, Kathrin %A Seufert, Anika %A Gamboa, Edwin %A Hirth, Matthias %A Hoßfeld, Tobias %D 2020 %J Quality and User Experience %T In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE? %X Evaluating the Quality of Experience (QoE) of video streaming and its influence factors has become paramount for streaming providers, as they want to maintain high satisfaction for their customers. In this context, crowdsourced user studies became a valuable tool to evaluate different factors which can affect the perceived user experience on a large scale. In general, most of these crowdsourcing studies either use, what we refer to, as an in vivo or an in vitro interface design. In vivo design means that the study participant has to rate the QoE of a video that is embedded in an application similar to a real streaming service, e.g., YouTube or Netflix. In vitro design refers to a setting, in which the video stream is separated from a specific service and thus, the video plays on a plain background. Although these interface designs vary widely, the results are often compared and generalized. In this work, we use a crowdsourcing study to investigate the influence of three interface design alternatives, an in vitro and two in vivo designs with different levels of interactiveness, on the perceived video QoE. Contrary to our expectations, the results indicate that there is no significant influence of the study’s interface design in general on the video experience. Furthermore, we found that the in vivo design does not reduce the test takers’ attentiveness. However, we observed that participants who interacted with the test interface reported a higher video QoE than other groups.
• Estimating Quality of Experience of Enterprise Applications - A Crowdsourcing-based Approach. Technical Report (PhD dissertation), . Borchert, Kathrin. PhD dissertation. University of Würzburg, 2020, October.
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @phdthesis{info3-dissertation-2020-1, author = {Borchert, Kathrin}, keywords = {sys:hidden:supervisor:tobias.hoßfeld}, month = 10, school = {University of Würzburg}, title = {Estimating Quality of Experience of Enterprise Applications - A Crowdsourcing-based Approach}, year = 2020 }

  %0 Thesis %1 info3-dissertation-2020-1 %A Borchert, Kathrin %D 2020 %T Estimating Quality of Experience of Enterprise Applications - A Crowdsourcing-based Approach
• Subjective perception of craniofacial growth asymmetries in patients with deformational plagiocephaly. Kunz, Felix; Hirth, Matthias; Schweitzer, Tilmann; Linz, Christian; Goetz, Berhard; Stellzig-Eisenhauer, Angelika; Borchert, Kathrin; Böhm, Hartmut. In Springer Clinical Oral Investigations, 24, pp. https://doi.org/10.1007/s00784–020. 2020.
  • [ BibTeX ]
  • [ EndNote ]
  @article{info3-article-2020-3, author = {Kunz, Felix and Hirth, Matthias and Schweitzer, Tilmann and Linz, Christian and Goetz, Berhard and Stellzig-Eisenhauer, Angelika and Borchert, Kathrin and Böhm, Hartmut}, journal = {Springer Clinical Oral Investigations}, keywords = {sys:hidden:article}, month = {07}, pages = {https://doi.org/10.1007/s00784-020-03417-y}, title = {Subjective perception of craniofacial growth asymmetries in patients with deformational plagiocephaly}, volume = 24, year = 2020 }

  %0 Journal Article %1 info3-article-2020-3 %A Kunz, Felix %A Hirth, Matthias %A Schweitzer, Tilmann %A Linz, Christian %A Goetz, Berhard %A Stellzig-Eisenhauer, Angelika %A Borchert, Kathrin %A Böhm, Hartmut %D 2020 %J Springer Clinical Oral Investigations %P https://doi.org/10.1007/s00784-020-03417-y %T Subjective perception of craniofacial growth asymmetries in patients with deformational plagiocephaly %V 24
• Personal Task Design Preferences of Crowdworkers. Hirth, Matthias; Borchert, Kathrin; de Moor, Katrien; Borst, Vanessa; Hoßfeld, Tobias. In 12th International Conference on Quality of Multimedia Experience (QoMEX). Athlone, Ireland, 2020.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2020-5, address = {Athlone, Ireland}, author = {Hirth, Matthias and Borchert, Kathrin and de Moor, Katrien and Borst, Vanessa and Hoßfeld, Tobias}, booktitle = {12th International Conference on Quality of Multimedia Experience (QoMEX)}, keywords = {ua-net}, month = {05}, title = {Personal Task Design Preferences of Crowdworkers}, year = 2020 }

  %0 Conference Paper %1 info3-inproceedings-2020-5 %A Hirth, Matthias %A Borchert, Kathrin %A de Moor, Katrien %A Borst, Vanessa %A Hoßfeld, Tobias %B 12th International Conference on Quality of Multimedia Experience (QoMEX) %C Athlone, Ireland %D 2020 %T Personal Task Design Preferences of Crowdworkers
• QoE Assessment of Enterprise Applications based on Self-motivated Ratings. Borchert, Kathrin; Seufert, Michael; Hildebrand, Kathrin; Hoßfeld, Tobias. In 12th International Conference on Quality of Multimedia Experience (QoMEX). Athlone, Ireland, 2020.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  In most companies, enterprise applications, such as office products or databases, are heavily used by employees during work hours. Impairments and performance issues not only slow down business processes, but might also increase the frustration of the workforce. While Quality of Experience (QoE) has been widely studied for personal multimedia applications, such as video streaming, its application to the business usage domain is still in its infancy. Due to several reasons, e.g., the high complexity of IT infrastructure, classical QoE studies can hardly be transferred to business applications. These studies are often independent from the context of usage and actively poll ratings from their participants. This work contrasts the commonly used "pull" method for collecting user ratings with a self-motivated "push" approach. This approach is inspired by complaint systems, in which users can directly report problems with a technical system as soon as they notice them. Therefore, performance assessments of a business application from employees of a cooperating company are collected with both rating systems during a time span of 1.5 years. Besides the analysis of the interaction of users with the "push" system, differences between the two methods are discussed. Further, QoE models for the monitored business application are derived based on the self-motivated "push" ratings.

  @inproceedings{info3-inproceedings-2020-3, abstract = {In most companies, enterprise applications, such as office products or databases, are heavily used by employees during work hours. Impairments and performance issues not only slow down business processes, but might also increase the frustration of the workforce. While Quality of Experience (QoE) has been widely studied for personal multimedia applications, such as video streaming, its application to the business usage domain is still in its infancy. Due to several reasons, e.g., the high complexity of IT infrastructure, classical QoE studies can hardly be transferred to business applications. These studies are often independent from the context of usage and actively poll ratings from their participants. This work contrasts the commonly used "pull" method for collecting user ratings with a self-motivated "push" approach. This approach is inspired by complaint systems, in which users can directly report problems with a technical system as soon as they notice them. Therefore, performance assessments of a business application from employees of a cooperating company are collected with both rating systems during a time span of 1.5 years. Besides the analysis of the interaction of users with the "push" system, differences between the two methods are discussed. Further, QoE models for the monitored business application are derived based on the self-motivated "push" ratings.}, address = {Athlone, Ireland}, author = {Borchert, Kathrin and Seufert, Michael and Hildebrand, Kathrin and Hoßfeld, Tobias}, booktitle = {12th International Conference on Quality of Multimedia Experience (QoMEX)}, keywords = {kubus}, month = {05}, title = {QoE Assessment of Enterprise Applications based on Self-motivated Ratings}, year = 2020 }

  %0 Conference Paper %1 info3-inproceedings-2020-3 %A Borchert, Kathrin %A Seufert, Michael %A Hildebrand, Kathrin %A Hoßfeld, Tobias %B 12th International Conference on Quality of Multimedia Experience (QoMEX) %C Athlone, Ireland %D 2020 %T QoE Assessment of Enterprise Applications based on Self-motivated Ratings %X In most companies, enterprise applications, such as office products or databases, are heavily used by employees during work hours. Impairments and performance issues not only slow down business processes, but might also increase the frustration of the workforce. While Quality of Experience (QoE) has been widely studied for personal multimedia applications, such as video streaming, its application to the business usage domain is still in its infancy. Due to several reasons, e.g., the high complexity of IT infrastructure, classical QoE studies can hardly be transferred to business applications. These studies are often independent from the context of usage and actively poll ratings from their participants. This work contrasts the commonly used "pull" method for collecting user ratings with a self-motivated "push" approach. This approach is inspired by complaint systems, in which users can directly report problems with a technical system as soon as they notice them. Therefore, performance assessments of a business application from employees of a cooperating company are collected with both rating systems during a time span of 1.5 years. Besides the analysis of the interaction of users with the "push" system, differences between the two methods are discussed. Further, QoE models for the monitored business application are derived based on the self-motivated "push" ratings.

• Crowd-based Study of Gameplay Impairments and Player Performance in DOTA 2. Hirth, Matthias; Borchert, Kathrin; Allendorf, Fabian; Metzger, Florian; Hoßfeld, Tobias. In 4th Internet-QoE Workshop: QoE-based Analysis and Management of Data Communication Networks (Internet-QoE’19). Los Cabos, Mexico, 2019.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2019-24, address = {Los Cabos, Mexico}, author = {Hirth, Matthias and Borchert, Kathrin and Allendorf, Fabian and Metzger, Florian and Hoßfeld, Tobias}, booktitle = {4th Internet-QoE Workshop: QoE-based Analysis and Management of Data Communication Networks (Internet-QoE'19)}, keywords = {ua-net}, month = 10, title = {Crowd-based Study of Gameplay Impairments and Player Performance in DOTA 2}, year = 2019 }

  %0 Conference Paper %1 info3-inproceedings-2019-24 %A Hirth, Matthias %A Borchert, Kathrin %A Allendorf, Fabian %A Metzger, Florian %A Hoßfeld, Tobias %B 4th Internet-QoE Workshop: QoE-based Analysis and Management of Data Communication Networks (Internet-QoE'19) %C Los Cabos, Mexico %D 2019 %T Crowd-based Study of Gameplay Impairments and Player Performance in DOTA 2
• Crowd-based Assessment of Deformational Cranial Asymmetries. Borchert, Kathrin; Hirth, Matthias; Stellzig-Eisenhauer, Angelika; Kunz, Felix. In International Workshop on Crowd-Powered e-Services (CROPS). Trondheim, Norway, 2019.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2019-17, address = {Trondheim, Norway}, author = {Borchert, Kathrin and Hirth, Matthias and Stellzig-Eisenhauer, Angelika and Kunz, Felix}, booktitle = {International Workshop on Crowd-Powered e-Services (CROPS)}, keywords = {ua-net}, month = {09}, title = {Crowd-based Assessment of Deformational Cranial Asymmetries}, year = 2019 }

  %0 Conference Paper %1 info3-inproceedings-2019-17 %A Borchert, Kathrin %A Hirth, Matthias %A Stellzig-Eisenhauer, Angelika %A Kunz, Felix %B International Workshop on Crowd-Powered e-Services (CROPS) %C Trondheim, Norway %D 2019 %T Crowd-based Assessment of Deformational Cranial Asymmetries
• Task Scheduling on Crowdsourcing Platforms for Enabling Completion Time SLAs. Hirth, Matthias; Steurer, Florian; Borchert, Kathrin; Dubiner, Dan. In 31st International Teletraffic Congress (ITC). Budapest, Hungary, 2019.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2019-20, address = {Budapest, Hungary}, author = {Hirth, Matthias and Steurer, Florian and Borchert, Kathrin and Dubiner, Dan}, booktitle = {31st International Teletraffic Congress (ITC)}, keywords = {ua-net}, month = {08}, title = {Task Scheduling on Crowdsourcing Platforms for Enabling Completion Time SLAs}, year = 2019 }

  %0 Conference Paper %1 info3-inproceedings-2019-20 %A Hirth, Matthias %A Steurer, Florian %A Borchert, Kathrin %A Dubiner, Dan %B 31st International Teletraffic Congress (ITC) %C Budapest, Hungary %D 2019 %T Task Scheduling on Crowdsourcing Platforms for Enabling Completion Time SLAs
• Using Attention Testing to Select Crowdsourced Workers and Research Participants. Göritz, Anja; Borchert, Kathrin; Hirth, Matthias. In Social Science Computer Review. 2019.
  • [ BibTeX ]
  • [ EndNote ]
  @article{info3-article-2019-7, author = {Göritz, Anja and Borchert, Kathrin and Hirth, Matthias}, journal = {Social Science Computer Review}, keywords = {sys:hidden:article}, month = {06}, title = {Using Attention Testing to Select Crowdsourced Workers and Research Participants}, year = 2019 }

  %0 Journal Article %1 info3-article-2019-7 %A Göritz, Anja %A Borchert, Kathrin %A Hirth, Matthias %D 2019 %J Social Science Computer Review %T Using Attention Testing to Select Crowdsourced Workers and Research Participants
• In Vivo or in Vitro? Influence of the Study Design on Crowdsourced Video QoE. Borchert, Kathrin; Schwind, Anika; Hirth, Matthias; Hoßfeld, Tobias. In 11th International Conference on Quality of Multimedia Experience (QoMEX). 2019.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2019-10, author = {Borchert, Kathrin and Schwind, Anika and Hirth, Matthias and Hoßfeld, Tobias}, booktitle = {11th International Conference on Quality of Multimedia Experience (QoMEX)}, keywords = {ua-net}, month = {06}, title = {In Vivo or in Vitro? Influence of the Study Design on Crowdsourced Video QoE}, year = 2019 }

  %0 Conference Paper %1 info3-inproceedings-2019-10 %A Borchert, Kathrin %A Schwind, Anika %A Hirth, Matthias %A Hoßfeld, Tobias %B 11th International Conference on Quality of Multimedia Experience (QoMEX) %D 2019 %T In Vivo or in Vitro? Influence of the Study Design on Crowdsourced Video QoE

• Identification of Delay Thresholds Representing the Perceived Quality of Enterprise Applications. Borchert, Kathrin; Lange, Stanislav; Zinner, Thomas; Hirth, Matthias. In The 2nd International Workshop on Quality of Experience Management. Sardinia, Italy, 2018.
  • [ BibTeX ]
  • [ EndNote ]
  @inproceedings{info3-inproceedings-2018-11, address = {Sardinia, Italy}, author = {Borchert, Kathrin and Lange, Stanislav and Zinner, Thomas and Hirth, Matthias}, booktitle = {The 2nd International Workshop on Quality of Experience Management}, keywords = {ua-net}, month = {05}, title = {Identification of Delay Thresholds Representing the Perceived Quality of Enterprise Applications}, year = 2018 }

  %0 Conference Paper %1 info3-inproceedings-2018-11 %A Borchert, Kathrin %A Lange, Stanislav %A Zinner, Thomas %A Hirth, Matthias %B The 2nd International Workshop on Quality of Experience Management %C Sardinia, Italy %D 2018 %T Identification of Delay Thresholds Representing the Perceived Quality of Enterprise Applications
• Unemployment and Online Labor. Borchert, Kathrin; Hirth, Matthias; Kummer, Michael; Laitenberger, Ulrich; Slivko, Olga; Viet, Steffen. 2018.
  • [ BibTeX ]
  • [ EndNote ]
  @misc{info3-misc-2018-1, author = {Borchert, Kathrin and Hirth, Matthias and Kummer, Michael and Laitenberger, Ulrich and Slivko, Olga and Viet, Steffen}, howpublished = {http://ftp.zew.de/pub/zew-docs/dp/dp18023.pdf}, keywords = {sys:hidden:misc}, title = {Unemployment and Online Labor}, year = 2018 }

  %0 Generic %1 info3-misc-2018-1 %A Borchert, Kathrin %A Hirth, Matthias %A Kummer, Michael %A Laitenberger, Ulrich %A Slivko, Olga %A Viet, Steffen %D 2018 %T Unemployment and Online Labor

• Designing a Survey Tool for Monitoring Enterprise QoE. Borchert, Kathrin; Hirth, Matthias; Zinner, Thomas; Göritz, Anja. In ACM SIGCOMM Workshop on QoE-based Analysis and Management of Data Communication Networks (Internet-QoE). Los Angeles, CA, USA, 2017.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Enterprise applications like SAP are part of the day-to-day work of a large number of employees. Similar to many modern applications, enterprise applications are often implemented in a distributed fashion and consequently suffer from network degradations resulting in impairments like increased loading delays. While the influence of these impairments on the perceived quality of users is well researched for consumer applications and network services, the impact of these impairments in a business environment is still unclear. To address this gap we develop a non-intrusive software tool for continuously collecting subjective ratings on the performance of an enterprise application from a large crowd of employees. Based on the feedback from a company and results from two initial field studies we discuss the specific challenges when assessing the perceived quality of employees during regular working hours and point our further research directions.

  @inproceedings{info3-inproceedings-2017-13, abstract = {Enterprise applications like SAP are part of the day-to-day work of a large number of employees. Similar to many modern applications, enterprise applications are often implemented in a distributed fashion and consequently suffer from network degradations resulting in impairments like increased loading delays. While the influence of these impairments on the perceived quality of users is well researched for consumer applications and network services, the impact of these impairments in a business environment is still unclear. To address this gap we develop a non-intrusive software tool for continuously collecting subjective ratings on the performance of an enterprise application from a large crowd of employees. Based on the feedback from a company and results from two initial field studies we discuss the specific challenges when assessing the perceived quality of employees during regular working hours and point our further research directions.}, address = {Los Angeles, CA, USA}, author = {Borchert, Kathrin and Hirth, Matthias and Zinner, Thomas and Göritz, Anja}, booktitle = {ACM SIGCOMM Workshop on QoE-based Analysis and Management of Data Communication Networks (Internet-QoE)}, keywords = {ua-net}, month = {08}, title = {Designing a Survey Tool for Monitoring Enterprise QoE}, year = 2017 }

  %0 Conference Paper %1 info3-inproceedings-2017-13 %A Borchert, Kathrin %A Hirth, Matthias %A Zinner, Thomas %A Göritz, Anja %B ACM SIGCOMM Workshop on QoE-based Analysis and Management of Data Communication Networks (Internet-QoE) %C Los Angeles, CA, USA %D 2017 %T Designing a Survey Tool for Monitoring Enterprise QoE %X Enterprise applications like SAP are part of the day-to-day work of a large number of employees. Similar to many modern applications, enterprise applications are often implemented in a distributed fashion and consequently suffer from network degradations resulting in impairments like increased loading delays. While the influence of these impairments on the perceived quality of users is well researched for consumer applications and network services, the impact of these impairments in a business environment is still unclear. To address this gap we develop a non-intrusive software tool for continuously collecting subjective ratings on the performance of an enterprise application from a large crowd of employees. Based on the feedback from a company and results from two initial field studies we discuss the specific challenges when assessing the perceived quality of employees during regular working hours and point our further research directions.
• Impact of Task Recommendation Systems in Crowdsourcing Platforms. Borchert, Kathrin; Hirth, Matthias; Schnitzer, Steffen; Rensing, Christoph. In Workshop on Responsible Recommendation at RecSys 2017. Como, Italy, 2017.
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{info3-inproceedings-2017-17, address = {Como, Italy}, author = {Borchert, Kathrin and Hirth, Matthias and Schnitzer, Steffen and Rensing, Christoph}, booktitle = {Workshop on Responsible Recommendation at RecSys 2017}, keywords = {sys:hidden:inproceedings}, month = {08}, title = {Impact of Task Recommendation Systems in Crowdsourcing Platforms}, year = 2017 }

  %0 Conference Paper %1 info3-inproceedings-2017-17 %A Borchert, Kathrin %A Hirth, Matthias %A Schnitzer, Steffen %A Rensing, Christoph %B Workshop on Responsible Recommendation at RecSys 2017 %C Como, Italy %D 2017 %T Impact of Task Recommendation Systems in Crowdsourcing Platforms
• Collecting Subjective Ratings in Enterprise Environments. Borchert, Kathrin; Hirth, Matthias; Zinner, Thomas; Göritz, Anja. In 9th International Conference on Quality of Multimedia Experience (QoMEX). Erfurt, Germany, 2017.
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{info3-inproceedings-2017-14, address = {Erfurt, Germany}, author = {Borchert, Kathrin and Hirth, Matthias and Zinner, Thomas and Göritz, Anja}, booktitle = {9th International Conference on Quality of Multimedia Experience (QoMEX)}, keywords = {ua-net}, month = {05}, title = {Collecting Subjective Ratings in Enterprise Environments}, year = 2017 }

  %0 Conference Paper %1 info3-inproceedings-2017-14 %A Borchert, Kathrin %A Hirth, Matthias %A Zinner, Thomas %A Göritz, Anja %B 9th International Conference on Quality of Multimedia Experience (QoMEX) %C Erfurt, Germany %D 2017 %T Collecting Subjective Ratings in Enterprise Environments
• Unemployment and Online Labor. Borchert, Kathrin. Workshop on Flexible Work in the Digital Age, ZEW Mannheim, Germany, 2017, March 24.
  • [ BibTeX ]
  • [ EndNote ]
  @presentation{info3-presentation-2017-1, address = {Workshop on Flexible Work in the Digital Age, ZEW Mannheim, Germany}, author = {Borchert, Kathrin}, keywords = {sys:hidden:presentation}, month = {03}, title = {Unemployment and Online Labor}, year = 2017 }

  %0 Generic %1 info3-presentation-2017-1 %A Borchert, Kathrin %C Workshop on Flexible Work in the Digital Age, ZEW Mannheim, Germany %D 2017 %T Unemployment and Online Labor

• Correlating QoE and Technical Parameters of an SAP System in an Enterprise Environment. Borchert, Kathrin; Hirth, Matthias; Zinner, Thomas; Mocanu, Decebal Constantin. In QCMan IEEE Workshop on QoE centric Management. 2016.
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  @inproceedings{info3-inproceedings-2016-15, author = {Borchert, Kathrin and Hirth, Matthias and Zinner, Thomas and Mocanu, Decebal Constantin}, booktitle = {QCMan IEEE Workshop on QoE centric Management}, keywords = {oekonet}, month = {09}, title = {Correlating QoE and Technical Parameters of an SAP System in an Enterprise Environment}, year = 2016 }

  %0 Conference Paper %1 info3-inproceedings-2016-15 %A Borchert, Kathrin %A Hirth, Matthias %A Zinner, Thomas %A Mocanu, Decebal Constantin %B QCMan IEEE Workshop on QoE centric Management %D 2016 %T Correlating QoE and Technical Parameters of an SAP System in an Enterprise Environment

• Modeling Crowdsourcing Platforms to Enable Workforce Dimensioning. Schwartz, Christian; Borchert, Kathrin; Hirth, Matthias; Tran-Gia, Phuoc. In International Telecommunication Networks and Applications Conference. Sydney, Australia, 2015.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Crowdsourcing platforms provide an easy and scalable access to human workforce that can, e.g., provide subjective judgements, tagging information, or even generate knowledge. In conjunction with machine clouds offering scalable access to computing resources, these human cloud provider offer numerous possibilities for creating new applications which would not have been possible a few years ago. However, in order to build sustainable services on top of this inter-cloud environment, scalability considerations have to be made. While cloud computing systems are already well studied in terms of dimensioning of the hardware resources, there still exists little work on the appropriate scaling of crowdsourcing platforms. This is especially challenging, as the complex interaction between all involved stakeholders, platform providers, workers and employers have to be considered. The contribution of this work is threefold. First we develop a model for common crowdsourcing platforms and implement the model using a simulative approach, which is validated with a comparison to an analytic M[X]/M/c − ∞ system. In a second step we evaluate inter-arrival times as well as campaign size distributions based on a dataset of a large commercial crowdsourcing platform to derive realistic model parameters and illustrate the differences to the analytic approximation. Finally, we perform a parameter study using the simulation model to derive guidelines for dimensioning crowdsourcing platforms, while considering relevant parameters for the involved stakeholders, i.e., the delay before work on a task begins and the work load of the workers.

  @inproceedings{info3-inproceedings-2015-529, abstract = {Crowdsourcing platforms provide an easy and scalable access to human workforce that can, e.g., provide subjective judgements, tagging information, or even generate knowledge. In conjunction with machine clouds offering scalable access to computing resources, these human cloud provider offer numerous possibilities for creating new applications which would not have been possible a few years ago. However, in order to build sustainable services on top of this inter-cloud environment, scalability considerations have to be made. While cloud computing systems are already well studied in terms of dimensioning of the hardware resources, there still exists little work on the appropriate scaling of crowdsourcing platforms. This is especially challenging, as the complex interaction between all involved stakeholders, platform providers, workers and employers have to be considered. The contribution of this work is threefold. First we develop a model for common crowdsourcing platforms and implement the model using a simulative approach, which is validated with a comparison to an analytic M[X]/M/c − ∞ system. In a second step we evaluate inter-arrival times as well as campaign size distributions based on a dataset of a large commercial crowdsourcing platform to derive realistic model parameters and illustrate the differences to the analytic approximation. Finally, we perform a parameter study using the simulation model to derive guidelines for dimensioning crowdsourcing platforms, while considering relevant parameters for the involved stakeholders, i.e., the delay before work on a task begins and the work load of the workers.}, address = {Sydney, Australia}, author = {Schwartz, Christian and Borchert, Kathrin and Hirth, Matthias and Tran-Gia, Phuoc}, booktitle = {International Telecommunication Networks and Applications Conference}, keywords = {crowdsourcing-design}, month = 11, title = {Modeling Crowdsourcing Platforms to Enable Workforce Dimensioning}, year = 2015 }

  %0 Conference Paper %1 info3-inproceedings-2015-529 %A Schwartz, Christian %A Borchert, Kathrin %A Hirth, Matthias %A Tran-Gia, Phuoc %B International Telecommunication Networks and Applications Conference %C Sydney, Australia %D 2015 %T Modeling Crowdsourcing Platforms to Enable Workforce Dimensioning %X Crowdsourcing platforms provide an easy and scalable access to human workforce that can, e.g., provide subjective judgements, tagging information, or even generate knowledge. In conjunction with machine clouds offering scalable access to computing resources, these human cloud provider offer numerous possibilities for creating new applications which would not have been possible a few years ago. However, in order to build sustainable services on top of this inter-cloud environment, scalability considerations have to be made. While cloud computing systems are already well studied in terms of dimensioning of the hardware resources, there still exists little work on the appropriate scaling of crowdsourcing platforms. This is especially challenging, as the complex interaction between all involved stakeholders, platform providers, workers and employers have to be considered. The contribution of this work is threefold. First we develop a model for common crowdsourcing platforms and implement the model using a simulative approach, which is validated with a comparison to an analytic M[X]/M/c − ∞ system. In a second step we evaluate inter-arrival times as well as campaign size distributions based on a dataset of a large commercial crowdsourcing platform to derive realistic model parameters and illustrate the differences to the analytic approximation. Finally, we perform a parameter study using the simulation model to derive guidelines for dimensioning crowdsourcing platforms, while considering relevant parameters for the involved stakeholders, i.e., the delay before work on a task begins and the work load of the workers.
• MicroTrails: Comparing Hypotheses about Task Selection on a Crowd Sourcing Platform. Becker, Martin; Borchert, Kathrin; Hirth, Matthias; Mewes, Hauke; Hotho, Andreas; Tran-Gia, Phuoc. In International Conference on Knowledge Technologies and Data-driven Business (I-KNOW). Graz, Austria, 2015.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  To optimize the workflow on commercial crowdsourcing platforms like Amazon Mechanical Turk or Microworkers, it is important to understand how users choose their tasks. Current work usually explores the underlying processes by employing user studies based on surveys with a limited set of participants. In contrast, we formulate hypotheses based on the different findings in these studies and, in- stead of verifying them based on user feedback, we compare them directly on data from a commercial crowdsourcing platform. For evaluation, we use a Bayesian approach called HypTrails which allows us to give a relative ranking of the corresponding hypotheses. The hypotheses considered, are for example based on task categories, monetary incentives or semantic similarity of task descriptions. We find that, in our scenario, hypotheses based on employers as well the the task descriptions work best. Overall, we objectively compare different factors influencing users when choosing their tasks. Our approach enables crowdsourcing companies to better understand their users in order to optimize their platforms, e.g., by incorporating the gained knowledge about these factors into task recommendation systems.

  @inproceedings{info3-inproceedings-2015-526, abstract = {To optimize the workflow on commercial crowdsourcing platforms like Amazon Mechanical Turk or Microworkers, it is important to understand how users choose their tasks. Current work usually explores the underlying processes by employing user studies based on surveys with a limited set of participants. In contrast, we formulate hypotheses based on the different findings in these studies and, in- stead of verifying them based on user feedback, we compare them directly on data from a commercial crowdsourcing platform. For evaluation, we use a Bayesian approach called HypTrails which allows us to give a relative ranking of the corresponding hypotheses. The hypotheses considered, are for example based on task categories, monetary incentives or semantic similarity of task descriptions. We find that, in our scenario, hypotheses based on employers as well the the task descriptions work best. Overall, we objectively compare different factors influencing users when choosing their tasks. Our approach enables crowdsourcing companies to better understand their users in order to optimize their platforms, e.g., by incorporating the gained knowledge about these factors into task recommendation systems.}, address = {Graz, Austria}, author = {Becker, Martin and Borchert, Kathrin and Hirth, Matthias and Mewes, Hauke and Hotho, Andreas and Tran-Gia, Phuoc}, booktitle = {International Conference on Knowledge Technologies and Data-driven Business (I-KNOW)}, keywords = {crowdsourcing-design}, month = 10, title = {MicroTrails: Comparing Hypotheses about Task Selection on a Crowd Sourcing Platform}, year = 2015 }

  %0 Conference Paper %1 info3-inproceedings-2015-526 %A Becker, Martin %A Borchert, Kathrin %A Hirth, Matthias %A Mewes, Hauke %A Hotho, Andreas %A Tran-Gia, Phuoc %B International Conference on Knowledge Technologies and Data-driven Business (I-KNOW) %C Graz, Austria %D 2015 %T MicroTrails: Comparing Hypotheses about Task Selection on a Crowd Sourcing Platform %X To optimize the workflow on commercial crowdsourcing platforms like Amazon Mechanical Turk or Microworkers, it is important to understand how users choose their tasks. Current work usually explores the underlying processes by employing user studies based on surveys with a limited set of participants. In contrast, we formulate hypotheses based on the different findings in these studies and, in- stead of verifying them based on user feedback, we compare them directly on data from a commercial crowdsourcing platform. For evaluation, we use a Bayesian approach called HypTrails which allows us to give a relative ranking of the corresponding hypotheses. The hypotheses considered, are for example based on task categories, monetary incentives or semantic similarity of task descriptions. We find that, in our scenario, hypotheses based on employers as well the the task descriptions work best. Overall, we objectively compare different factors influencing users when choosing their tasks. Our approach enables crowdsourcing companies to better understand their users in order to optimize their platforms, e.g., by incorporating the gained knowledge about these factors into task recommendation systems.
• Demands on Task Recommendation in Crowdsourcing Platforms - The Worker’s Perspective. Schnitzer, Steffen; Rensing, Christoph; Schmidt, Sebastian; Borchert, Kathrin; Hirth, Matthias; Tran-Gia, Phuoc. In CrowdRec Workshop. Vienna, Austria, 2015.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  Crowdsourcing platforms support the assignment of jobs to help requesters in their project completion and allow workers to earn money. Most crowdsourcing platforms apply simple schemes in order to filter the tasks a worker can choose from or rely on the workers’ search capabilities. Using genuine task recommendation within such crowdsourcing plat- forms opens promising opportunities. Such recommendation schemes will only be effective if the workers are confident that they are used towards their own good. In order to gain insights on what kind of recommendations the workers would expect and accept, this work provides an empirical study about the demands of the workers.

  @inproceedings{info3-inproceedings-2015-525, abstract = {Crowdsourcing platforms support the assignment of jobs to help requesters in their project completion and allow workers to earn money. Most crowdsourcing platforms apply simple schemes in order to filter the tasks a worker can choose from or rely on the workers’ search capabilities. Using genuine task recommendation within such crowdsourcing plat- forms opens promising opportunities. Such recommendation schemes will only be effective if the workers are confident that they are used towards their own good. In order to gain insights on what kind of recommendations the workers would expect and accept, this work provides an empirical study about the demands of the workers.}, address = {Vienna, Austria}, author = {Schnitzer, Steffen and Rensing, Christoph and Schmidt, Sebastian and Borchert, Kathrin and Hirth, Matthias and Tran-Gia, Phuoc}, booktitle = {CrowdRec Workshop}, keywords = {crowdsourcing-design}, month = {09}, title = {Demands on Task Recommendation in Crowdsourcing Platforms - The Worker’s Perspective}, year = 2015 }

  %0 Conference Paper %1 info3-inproceedings-2015-525 %A Schnitzer, Steffen %A Rensing, Christoph %A Schmidt, Sebastian %A Borchert, Kathrin %A Hirth, Matthias %A Tran-Gia, Phuoc %B CrowdRec Workshop %C Vienna, Austria %D 2015 %T Demands on Task Recommendation in Crowdsourcing Platforms - The Worker’s Perspective %X Crowdsourcing platforms support the assignment of jobs to help requesters in their project completion and allow workers to earn money. Most crowdsourcing platforms apply simple schemes in order to filter the tasks a worker can choose from or rely on the workers’ search capabilities. Using genuine task recommendation within such crowdsourcing plat- forms opens promising opportunities. Such recommendation schemes will only be effective if the workers are confident that they are used towards their own good. In order to gain insights on what kind of recommendations the workers would expect and accept, this work provides an empirical study about the demands of the workers.

• Evaluation of Video Quality Monitoring based on Pre-computed Frame Distortions. Klein, Dominik; Zinner, Thomas; Borchert, Kathrin; Lange, Stanislav; Singeorzan, Vlad; Schmid, Matthias. In 19th EUNICE Workshop on Advances in Communication Networking, Best Paper Award. Chemnitz, Germany, 2013.
  • [ Abstract ]
  • [ BibTeX ]
  • [ EndNote ]
  • [ Download ]
  A large fraction of the current Internet traffic is caused by video streaming. Due to the growing expectations of video consumers, monitoring video applications is getting more and more important for network and service providers. In a previous work, we proposed a video quality monitoring solution which utilizes the full reference SSIM metric to improve the monitoring in the network by distributing pre-computed distortion information induced by frame losses. To improve scalability, we introduced a less complex algorithm which infers the distortion for higher loss scenarios from single loss scenarios and inter-frame dependencies. In this work, we evaluate the accuracy of our algorithm by comparing it with the exact calculation of the SSIM metric for different frame loss scenarios. We further consider different high definition test video sequences and group of picture structures and investigate the influence on the accuracy of our proposed approximation.

  @inproceedings{info3-inproceedings-2013-474, abstract = {A large fraction of the current Internet traffic is caused by video streaming. Due to the growing expectations of video consumers, monitoring video applications is getting more and more important for network and service providers. In a previous work, we proposed a video quality monitoring solution which utilizes the full reference SSIM metric to improve the monitoring in the network by distributing pre-computed distortion information induced by frame losses. To improve scalability, we introduced a less complex algorithm which infers the distortion for higher loss scenarios from single loss scenarios and inter-frame dependencies. In this work, we evaluate the accuracy of our algorithm by comparing it with the exact calculation of the SSIM metric for different frame loss scenarios. We further consider different high definition test video sequences and group of picture structures and investigate the influence on the accuracy of our proposed approximation.}, address = {Chemnitz, Germany}, author = {Klein, Dominik and Zinner, Thomas and Borchert, Kathrin and Lange, Stanislav and Singeorzan, Vlad and Schmid, Matthias}, booktitle = {19th EUNICE Workshop on Advances in Communication Networking, Best Paper Award}, keywords = {video-quality}, month = {08}, title = {Evaluation of Video Quality Monitoring based on Pre-computed Frame Distortions}, year = 2013 }

  %0 Conference Paper %1 info3-inproceedings-2013-474 %A Klein, Dominik %A Zinner, Thomas %A Borchert, Kathrin %A Lange, Stanislav %A Singeorzan, Vlad %A Schmid, Matthias %B 19th EUNICE Workshop on Advances in Communication Networking, Best Paper Award %C Chemnitz, Germany %D 2013 %T Evaluation of Video Quality Monitoring based on Pre-computed Frame Distortions %X A large fraction of the current Internet traffic is caused by video streaming. Due to the growing expectations of video consumers, monitoring video applications is getting more and more important for network and service providers. In a previous work, we proposed a video quality monitoring solution which utilizes the full reference SSIM metric to improve the monitoring in the network by distributing pre-computed distortion information induced by frame losses. To improve scalability, we introduced a less complex algorithm which infers the distortion for higher loss scenarios from single loss scenarios and inter-frame dependencies. In this work, we evaluate the accuracy of our algorithm by comparing it with the exact calculation of the SSIM metric for different frame loss scenarios. We further consider different high definition test video sequences and group of picture structures and investigate the influence on the accuracy of our proposed approximation.