<?xml version="1.0" encoding="UTF-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0">
    <teiHeader>
        <fileDesc>
            <titleStmt>
                <title type="full">
                    <title type="main">Pages of Early Soviet Performance: Transforming images of Soviet performing arts periodicals into data for computational analysis</title>
                </title>
                <author>
                    <persName>
                        <surname>Ermolaev</surname>
                        <forename>Natalia</forename>
                    </persName>
                    <affiliation>Princeton University, United States of America</affiliation>
                    <email>nataliae@princeton.edu</email>
                </author>
                <author>
                    <persName>
                        <surname>Puchkovskaia</surname>
                        <forename>Antonina</forename>
                    </persName>
                    <affiliation>ITMO University, Russian Federation</affiliation>
                    <email>artonina@gmail.com</email>
                </author>
                <author>
                    <persName>
                        <surname>Reischl</surname>
                        <forename>Katherine</forename>
                    </persName>
                    <affiliation>Princeton University, United States of America</affiliation>
                    <email>kreischl@princeton.edu</email>
                </author>
                <author>
                    <persName>
                        <surname>Keenan</surname>
                        <forename>Thomas</forename>
                    </persName>
                    <affiliation>Princeton University, United States of America</affiliation>
                    <email>tkeenan@princeton.edu</email>
                </author>
                <author>
                    <persName>
                        <surname>Janco</surname>
                        <forename>Andrew</forename>
                    </persName>
                    <affiliation>Haverford College, United States of America</affiliation>
                    <email>ajanco@haverford.edu</email>
                </author>
                <author>
                    <persName>
                        <surname>Jacobson</surname>
                        <forename>Alexander</forename>
                    </persName>
                    <affiliation>Princeton University, United States of America</affiliation>
                    <email>alexander.jacobson@princeton.edu</email>
                </author>
                <author>
                    <persName>
                        <surname>Kudryashov</surname>
                        <forename>Alexander</forename>
                    </persName>
                    <affiliation>ITMO University, Russian Federation</affiliation>
                    <email>alexndr.kudryashov@gmail.com</email>
                </author>
            </titleStmt>
            <editionStmt>
                <edition>
                    <date>2021-06-01T21:20:11.90</date>
                </edition>
            </editionStmt>
            <publicationStmt>
                <publisher>Elisabeth Burr, University of Leipzig</publisher>
                <address>
                    <addrLine>Beethovenstr. 15</addrLine>
                    <addrLine>04107 Leipzig</addrLine>
                    <addrLine>Germany</addrLine>
                    <addrLine>Elisabeth Burr</addrLine>
                </address>
            </publicationStmt>
            <sourceDesc>
                <p>Converted from an OASIS Open Document</p>
            </sourceDesc>
        </fileDesc>
        <encodingDesc>
            <appInfo>
                <application ident="DHCONVALIDATOR" version="1.22">
                    <label>DHConvalidator</label>
                </application>
            </appInfo>
        </encodingDesc>
        <profileDesc>
            <textClass>
                <keywords scheme="ConfTool" n="category">
                    <term>Paper</term>
                </keywords>
                <keywords scheme="ConfTool" n="subcategory">
                    <term>Poster Presentation</term>
                </keywords>
                <keywords scheme="ConfTool" n="keywords">
                    <term>computer vision</term>
                    <term>digitization</term>
                    <term>collections as data</term>
                </keywords>
                <keywords scheme="ConfTool" n="topics">
                    <term>Conversion</term>
                    <term>DataRecognition</term>
                    <term>Imaging</term>
                    <term>Designing</term>
                    <term>Programming</term>
                    <term>Annotating</term>
                    <term>Stylistic Analysis</term>
                    <term>Visualization</term>
                    <term>Modeling</term>
                    <term>Archiving</term>
                    <term>Organizing</term>
                    <term>Collaboration</term>
                    <term>Commenting</term>
                    <term>Meta: CommunityBuilding</term>
                    <term>Images</term>
                    <term>TextBearingObjects</term>
                    <term>Tools</term>
                    <term>Methods</term>
                    <term>English</term>
                </keywords>
            </textClass>
        </profileDesc>
    </teiHeader>
    <text>
        <body>
            <p>Our project has created a dataset of rare, early-Soviet illustrated periodicals related to the
                    performing arts, including <hi rend="italic">Rabis</hi>, <hi rend="italic">Rabochii teatr</hi>, <hi rend="italic">Zreslishcha</hi>, <hi rend="italic">30 dnei</hi> and <hi rend="italic">Ermitazh</hi>. Through utilizing machine
                    learning techniques we aim to better understand this rich cultural material and to facilitate new avenues of
                    research about Soviet culture during the first decades after the October Revolution (1917-1932). The poster
                    will outline our workflow from scanned images to computer vision models to data for analysis. We used
                    transfer learning to add new labels to a Yolo v5 computer vision model. For this task, we created annotation
                    data using <hi rend="italic">makesense.ai</hi> (Skalski 2019-) and a custom annotation tool called <hi rend="italic">Mayakovsky</hi>. After initial training on 100
                    annotations, we further refined the model using 400 annotations to increase precision and the model’s ability
                    to distinguish between text, titles, images, and mixed text categories. Using the trained Yolo model we were
                    able to identify images in the collection and to create a separate collection of images. These files were then
                    labeled with Google Vision and described by a text generation model from IBM. The resulting files and
                    metadata can be viewed and researched using PixPlot from the Yale DH Lab. This is an iterative process
                    where domain experts identify relevant objects, we annotate those objects in the images, then a model is
                    trained, and we assess what the model has learned and interpret its results. EADH participants will gain an
                    introduction to our project and its outcomes as well as a detailed discussion of our process and design
                    choices which can be applied to comparable digitization and digital humanities projects that seek to
                    transform collections into data</p>
        </body>
        <back>
            <div type="bibliogr">
                <listBibl>
                    <head>Bibliography</head>
                    <bibl>
                        <hi rend="bold">Skalski, Piotr</hi> (2019-): <hi rend="italic"
                            >makesense.ai</hi>. Free to use online tool for labelling photos
                        &lt;<ref
                            target="https://www.makesense.ai/">
                            https://www.makesense.ai/</ref>&gt; [21.08.2021].</bibl>
                </listBibl>
            </div>
        </back>
    </text>
</TEI>
