About The Research Foundation for SUNY at Binghamton
Binghamton University is a premier public R1 research institution in the State University of New York (SUNY) system that unites more than 130 broadly interdisciplinary educational programs with some of the most vibrant research in the nation. Our unique character - shaped by our mission, outstanding academics, facilities, and community life - promotes extraordinary student success, research, and service; Binghamton University is where our students, faculty and staff thrive
Working at Binghamton University is about more than having a great job - it is about having the opportunity to flourish in an exciting, engaging environment. Our faculty and staff appreciate Binghamton's collegial and inclusive culture and its commitment to excellence, education, innovation and civic engagement. Our diverse campus community contributes to our success. Embedded within the University, The Research Foundation (RF) exists to serve SUNY and to capitalize on the scope, scale and diversity of SUNY as an engine of New York State's innovation economy. We are the largest comprehensive university-connected research foundation in the country. The RF is mission focused and serves Binghamton University by providing essential administrative services that enable faculty to focus their efforts on the education of students and the performance of life-changing research. As a private not-for-profit corporation, we support nearly $1 billion in SUNY research activity annually, providing sponsored programs administration and commercialization support services to SUNY faculty performing research in numerous disciplines.
The RF offers a comprehensive benefits package that is a valuable part of our total compensation. Included in the benefits package are comprehensive health, dental, and vision insurance, dependent care and healthcare spending accounts, employer retirement contributions at 7% of earnings, retiree health benefits and more! The RF promotes employee work/life balance through generous paid leave offerings and wellness resources for employees and their families. Furthermore, our 10 Perks of Working at the RF provides an at-a-glance view of our top benefits that make us a great place to work. Employees receive support throughout their career with access to professional development opportunities across campus, college savings plans, access to public student loan forgiveness programs, a tuition waiver program, and much more!
Job Description
The Postdoctoral Associate will address safety and transparency gaps in our understanding of AI companions (e.g., risks like self-harm and deceptive/unwarranted anthropomorphization).
More specifically, the postdoc will research the extraction and application of character trait vectors for inference time steering. This involves techniques in the area of mechanistic interpretation. E.g., monitoring neuron activation patterns across model layers when the system is prompted with datasets designed to induce specific traits like philosophical archetypes. By identifying these activation signatures, we can develop steering mechanisms to influence model behavior at inference time. While inference time steering has a per-query cost vs. the one time cost of fine tuning, in the case of AI companions it allows for essentially infinite combinations of specific personality "facets" and how much individual facets should be scaled on a per-end-user basis, without the cost of any additional training.
Objectives:
- How character traits are represented across different architectures. For example, dense vs. Mixture of Experts architectures, where specific experts might diverge in trait expression, resulting in unexpected (and potentially dangerous) behavior with certain types of interactions.
- Understanding how complexity and stability of character traits evolve with respect to model parameter count. For example, some has shown that larger models can exhibit emerging mechanisms to "resist" alignment or even hide certain behavior when in a testing environment.
- Developing methods for efficient computation of character traits. There is a per-query cost for inference time steering, regardless of its advantages over fine tuning for AI companions. As part of this project, the fellow will explore mechanisms to reduce these costs.
The Postdoctoral Associate will:
- Design and implement experiments focused on understanding and modifying the behavior of Generative AI models.
- Lead projects related to AI Companions and mentor graduate and undergraduate students.
- Prepare manuscripts for submission to top Computer Science venues.
Requirements:
- PhD in Computer Science or closely related field.
- Strong research record demonstrated by publications in top AI/NLP/Security venues.
- Research experience working with Generative AI applications and internals.
- Programming experience (Rust, C++, Python, and Cuda preferred).
- Ability to conduct independent research and work collaboratively with graduate students.
Additional Information:
Salary: $85,000 annually. Note: Visa sponsorship is not available for this position.
Research Foundation Commitment to Equal Employment Opportunity
As an Equal Opportunity / Affirmative Action Employer, The Research Foundation for SUNY will not discriminate in its employment practices due to an applicant's race, color, creed, religion, sex, pregnancy-related conditions, reproductive health decisions, childbirth or related medical conditions, sexual orientation, gender identity or expression, transgender status, age, national origin or ancestry, marital status, familial status, citizenship, physical and mental disability, prior arrest or conviction record, genetic characteristics/genetic information, predisposition or carrier status, domestic violence victim status, military status or service, veteran status, or any other characteristics protected under federal, state or local law. The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.
The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.
Review of applications will begin immediately and continue until the position is filled.
The Research Foundation for SUNY is a private, not for profit corporation and is a separate employer from SUNY and the State of New York and offers separate compensation and benefit plans.
Binghamton University is a tobacco-free campus.
Application Instructions:
All applicants must apply through this Hirezon/Interview Exchange system and should submit:
- Resume/CV
- Cover letter which addresses the specific reasons for your interest in this opportunity.
- Names and contact information of two individuals who can provide recommendations
You may add additional files/documents after uploading your resume/vitae.
After filling out the contact information, you will be directed to the upload page.
Returning Applicants - Login to your The Research Foundation for SUNY at Binghamton Careers Account to check your completed application.
Please contact us if you need assistance applying through this website.