Annotation Manager

Functional

Category Status: 15-Fac.Non-Tenured,Continuing Con

Applicant Search Category: Faculty

University Authorized FTE: 100

Unit: VPR-Applied Research Lab for Intelligence & Security

Campus/College Information:
Founded in 1856, University of Maryland, College Park is the state’s flagship institution. Our 1,250-acre College Park campus is just minutes away from Washington, D.C., and the nexus of the nation’s legislative, executive, and judicial centers of power. This unique proximity to business and technology leaders, federal departments and agencies, and a myriad of research entities, embassies, think tanks, cultural centers, and non-profit organizations is simply unparalleled. Synergistic opportunities for our faculty and students abound and are virtually limitless in the nation’s capital and surrounding areas. The University is committed to attracting and retaining outstanding and diverse faculty and staff that will enhance our stature of preeminence in our three missions of teaching, scholarship, and full engagement in our community, the state of Maryland, and in the world.

Vaccine Protocol

The University of Maryland has made the safety of our students, faculty and staff, and our surrounding communities a top priority. As part of that commitment, the University System of Maryland (USM) recently announced that students, faculty, and staff on USM campuses this fall, including UMD, are required to be vaccinated against COVID. As a prospective and/or a new employee at UMD, you will be required to comply with the University’s vaccination protocol. Proof of full vaccination will be required before the start of employment in order to work at any University of Maryland location. Prospective or new employees may seek a medical or religious exemption to the vaccination requirement at return.umd.edu and must have an approved exemption prior to the start of their employment.

Position Summary/Purpose of Position:
The University of Maryland Applied Research Lab for Intelligence and Security (ARLIS) is seeking an applicant to provide administrative and data management support on several annotation projects. Annotation projects may be focused on event detection, relevance to adjudicative guidelines, or other topics/domains. Most annotation projects will include foreign language components, such as adapting existing annotation guidelines for new languages. So, specialization in a specific language or family – especially Arabic, Korean, Chinese, Russian, or Persian – is desirable, but not required for the position.

Duties:
Organize, coordinate, and run consensus meetings

Organize and prepare annotation material, annotation assignments

Prepare and edit annotation guidelines and annotation workflows; take notes during consensus meetings to capture changes in understanding of annotation guidelines

Provide training to annotators on how to annotate within an annotation platform (MAT, Excel, Prodigy, etc.)

Advertise and recruit annotators and language specialists who can perform annotation tasks

Manage recruitment, hiring and training of annotators; manage project side contracting and invoicing for annotators; serve as main POC for consultant annotators regarding contracting and invoicing issues, coordinate with ARLIS administration team as needed

Respond to questions from annotators regarding annotation guidelines and task priorities for annotators

Utilize software to track annotation and annotation assignments

Minimum Qualifications:
Bachelor’s degree in Library Science, Linguistics, Data Science, Data Management, or a related discipline;

Excellent written and oral communication skills

Proficiency in language other than English

Experience with MS Office Suite, Google Drive suite, Slack, Zoom

Demonstrated ability to learn new technologies and platforms

Previous annotation experience

Preferences:
Knowledge/experience with University IRB applications and practices

Familiarity with methods for assessing inter-annotator agreement

Experience in management and training of sub-contractors

Experience with annotation and/or analysis of natural language data (text or speech)

U.S. citizen preferred

Additional Certifications:Additional Information:
Posting Date: 08/16/2021

Closing Date: 09/10/2021

Open Until Filled No

Best Consideration Date 09/13/2021

Physical Demands

Diversity Statement:
The University of Maryland, College Park, an equal opportunity/affirmative action employer, complies with all applicable federal and state laws and regulations regarding nondiscrimination and affirmative action; all qualified applicants will receive consideration for employment. The University is committed to a policy of equal opportunity for all persons and does not discriminate on the basis of race, color, religion, sex, national origin, physical or mental disability, protected veteran status, age, gender identity or expression, sexual orientation, creed, marital status, political affiliation, personal appearance, or on the basis of rights secured by the First Amendment, in all aspects of employment, educational programs and activities, and admissions.