Principal Systems Engineer/ Senior Systems Engineer #208
Apply NowCompany: United States Senate
Location: San Francisco, CA 94112
Description:
Principal Systems Engineer/ Senior Systems Engineer #208
Department: Chief Information Officer
Posting Date Range: 3/6/2025-Until Filled
Pay Grade Range: $99518-$175868
WorkHours: 8:30am-5:30pm
FLSA Status: Exempt
Remote Work Status: Remote
All remote or hybrid work arrangements must be performed from within the continental United States, subject to Sergeant at Arms approval.
This vacancy announcement closes at 7pm EST. Late applications will not be accepted.
JOB OVERVIEW
Job Description
Senior Systems Engineer
The position requires solid analytical and technical skills and the ability to learn new technologies quickly. The candidate should be familiar with recognizing and onboarding new data sources into Splunk, analyzing the data for anomalies and trends, and highlighting key trends within the data structure. The Senior Systems Engineer should be familiar with a Linux environment and with editing and maintaining Splunk configuration files and applications.
The Senior Systems Engineer will collaborate across departments with Engineering team members, interact with end users to gather requirements, perform troubleshooting, and assist with creating Splunk search queries. The Senior Engineer will be required to interact with senior management as necessary.
Principal Systems Engineer
The Principal Systems Engineer oversees collaboration across departments with Engineering team members, interacts with end users to gather requirements, performs troubleshooting, and assists with creating Splunk search queries and onboarding new data sources into Splunk, analyzing the data for anomalies and trends. The Principal Systems Engineer will also be required to interact with senior management as necessary.
Key Accountabilities/Essential Job Duties
Contributes to the section's work effort in responding to incidents from other sections, including the help desk. Supports tasks which may include helping to develop standard operating procedures, assignments, and coordination of work efforts to address issues. Assists users with computer needs such as installing and configuring software/hardware on their PC; troubleshoots problems with user systems. Provisions new accounts for users. Supports the section's work effort to develop processes and procedures to streamline the resolution of issues. Provides technical support for Senate information technology or telecommunications services, systems, hardware, software, and storage solutions to the users; supports Senate offices, contract support vendors, and other technical staff in troubleshooting and managing the various Senate environments. Maintains and monitors LAN/WAN and SAN operations and solves LAN/WAN and SAN applications problems; installs integrates, customizes, enhances, troubleshoots, and tests LAN and SAN hardware and software. Assists in installing, upgrading, customizing, tuning, and maintaining databases for optimal performance and availability; assists in developing, testing, and implementing database store procedures, functions, triggers, views, and packages. Conducts acceptance and integration testing; assists vendor systems implementation by troubleshooting related system issues affecting Senate users. Analyzes, designs, develops, implements, and maintains applications to meet the needs of Senate users; assists with product evaluations and implementation. Attends internal training provided by subject matter experts to understand operational tasks, documents support needs, and share the information within the assigned section. Other duties as assigned.
JOB SPECIFICATIONS
Required Education
High School Diploma, GED or an equivalent combination of education and work experience.
Other Duties/Responsibilities
Required Work Experience
Senior Systems Engineer
Principal Systems Engineer
Required Special Skills/ Knowledge
Senior Systems Engineer
Principal Systems Engineer
As part of our hiring process, we may conduct a skills assessment to better understand an applicant's proficiency in key areas relevant to the role.
Desired Qualifications
Senior Systems Engineer
Principal Systems Engineer
Working Conditions
Security Clearance
CONDITIONS OF EMPLOYMENT
To be employed by a Senate employing office in a paid position in the continental United States an individual must:
1. Be a U.S. citizen;
2. Be lawfully admitted for permanent residence and seeking citizenship as outlined in 8 U.S.C. 1324b(a)(3)(B);
3. Be (i) admitted as a refugee under 8 U.S.C. 1157 or granted asylum under 8 U.S.C. 1158 and (ii) have filed a declaration of intention to become a lawful permanent resident and then a citizen when eligible; or
4. Owe allegiance to the U.S. (i.e., qualify as a non-citizen U.S. national under federal law).
Employment is contingent on background / security investigation results.
BENEFITS AT-A-GLANCE
The SAA provides a highly competitive benefitspackage for all SAA staff. Our benefits extend beyond health care coverage tohelp provide employees with student loan reimbursement, professionaldevelopment, transportation subsidy, TSP/retirement savings, access to ourEmployee Assistance Program, and more! For more information regarding SAA'sbenefits, please visit https://sen.gov/OPPW.
ACCOMMODATIONS
As an Equal Opportunity Employer, the SAA is committed to providing reasonable accommodations to applicants with disabilities. If you are interested in applying for employment with SAA and need special assistance or an accommodation to complete the application process, please submit your request to employment@saa.senate.gov email with "Accommodation" in the subject line.
VOLUNTARY SELF-IDENTIFICATION FOR VETERANS' PREFERENCE
If you are identifying as veterans' preference eligible underthe VEOA, please use this link to complete your application for Veterans' Preference AFTER you apply for this position. The link will also be available on the "Thank You" page after you have submitted your job application.
Candidates only need to apply one time for veterans' preference tobe considered for all future veterans' preference positions within the SenateSergeant at Arms.
An applicantwho declines to self-identify as a disabled veteran and/or to provideinformation and documentation regarding his/her disabled veteran's status willnot be subjected to an adverse employment action, but the individual may beruled ineligible for veterans'preference.
Department: Chief Information Officer
Posting Date Range: 3/6/2025-Until Filled
Pay Grade Range: $99518-$175868
WorkHours: 8:30am-5:30pm
FLSA Status: Exempt
Remote Work Status: Remote
All remote or hybrid work arrangements must be performed from within the continental United States, subject to Sergeant at Arms approval.
This vacancy announcement closes at 7pm EST. Late applications will not be accepted.
JOB OVERVIEW
Job Description
Senior Systems Engineer
The position requires solid analytical and technical skills and the ability to learn new technologies quickly. The candidate should be familiar with recognizing and onboarding new data sources into Splunk, analyzing the data for anomalies and trends, and highlighting key trends within the data structure. The Senior Systems Engineer should be familiar with a Linux environment and with editing and maintaining Splunk configuration files and applications.
The Senior Systems Engineer will collaborate across departments with Engineering team members, interact with end users to gather requirements, perform troubleshooting, and assist with creating Splunk search queries. The Senior Engineer will be required to interact with senior management as necessary.
Principal Systems Engineer
The Principal Systems Engineer oversees collaboration across departments with Engineering team members, interacts with end users to gather requirements, performs troubleshooting, and assists with creating Splunk search queries and onboarding new data sources into Splunk, analyzing the data for anomalies and trends. The Principal Systems Engineer will also be required to interact with senior management as necessary.
Key Accountabilities/Essential Job Duties
Contributes to the section's work effort in responding to incidents from other sections, including the help desk. Supports tasks which may include helping to develop standard operating procedures, assignments, and coordination of work efforts to address issues. Assists users with computer needs such as installing and configuring software/hardware on their PC; troubleshoots problems with user systems. Provisions new accounts for users. Supports the section's work effort to develop processes and procedures to streamline the resolution of issues. Provides technical support for Senate information technology or telecommunications services, systems, hardware, software, and storage solutions to the users; supports Senate offices, contract support vendors, and other technical staff in troubleshooting and managing the various Senate environments. Maintains and monitors LAN/WAN and SAN operations and solves LAN/WAN and SAN applications problems; installs integrates, customizes, enhances, troubleshoots, and tests LAN and SAN hardware and software. Assists in installing, upgrading, customizing, tuning, and maintaining databases for optimal performance and availability; assists in developing, testing, and implementing database store procedures, functions, triggers, views, and packages. Conducts acceptance and integration testing; assists vendor systems implementation by troubleshooting related system issues affecting Senate users. Analyzes, designs, develops, implements, and maintains applications to meet the needs of Senate users; assists with product evaluations and implementation. Attends internal training provided by subject matter experts to understand operational tasks, documents support needs, and share the information within the assigned section. Other duties as assigned.
JOB SPECIFICATIONS
Required Education
High School Diploma, GED or an equivalent combination of education and work experience.
Other Duties/Responsibilities
- Participate in on-site and on-call rotation.
Required Work Experience
Senior Systems Engineer
- Five to eight years of relevant work experience (GED), three to six years (Associates), one to three years (Bachelor's), one to two years (Master's).
Principal Systems Engineer
- Eight to ten years of relevant work experience (GED), six to eight years (Associates), four to six years (Bachelor's), two to four years (Master's).
Required Special Skills/ Knowledge
Senior Systems Engineer
- Manages current storage capacity and ensures storage is available to support all computing environments; plans for future storage growth; monitors and confirms that system files and application products are successfully backed-up; performs necessary installations, patches, and upgrades.
- Works escalated issues from lower-tier team members. Mentors/relays information on solutions to train others.
- Analyzes new hardware and software releases for their impact on the Senate environment; tests new releases on Senate supported platforms; develops product configuration standards for use in the Senate environment.
- Creates, develops, modifies, instructs and provides technical assistance on business continuity plans and processes.
Principal Systems Engineer
- Provides long-range strategic planning activities for the Senate in the areas of information technology or telecommunications hardware, software, storage solutions, and networking systems; monitors the impact of technological developments; identifies emerging technologies.
- Provides expert-level technical support on Senate hardware, software, storage solutions, and network systems to vendors, other technical staff, and other divisions and departments; resolves critical and complex systems, applications, storage or communications performance problems.
- Serves as project manager on assigned projects; plans, assigns, directs and coordinates work efforts; develops project plans, timetables and staff assignments.
- Customizes, tests, recommends and configures operating and network systems and software platforms; monitors, evaluates and resolves hardware/software configuration system performance problems; recommends third party software on other operating systems.
As part of our hiring process, we may conduct a skills assessment to better understand an applicant's proficiency in key areas relevant to the role.
Desired Qualifications
Senior Systems Engineer
- 5+ years of proficiency experience with Splunk systems administration.
- Experience in a Splunk administration role.
- Demonstrated experience in application interface development using REST APIs.
- Demonstrated experience with a scripting languages like Ansible, Python, and JavaScript.
Principal Systems Engineer
- 8+ years of expert-level experience in Splunk systems administration.
- Expert-level experience in a Splunk administration role.
- Demonstrated experience in application interface development using REST APIs.
- Demonstrated experience with a scripting language like Ansible, Python, and JavaScript.
Working Conditions
- The U.S. Senate network cannot be taken offline for maintenance during the workday, or while the Senate is in session. As such, maintenance windows may only occur at night, on weekends, and occasionally on holidays. Employees who perform systems upgrades, maintenance, wiring, backups, support our alternate data centers will have schedules that include working nights, weekends, and holidays.
Security Clearance
- This position requires that the applicant obtain and maintain a Secret U.S. Government security clearance.
- Applicants must be U.S. citizens in order for the SAA to submit your application for a security clearance.
CONDITIONS OF EMPLOYMENT
To be employed by a Senate employing office in a paid position in the continental United States an individual must:
1. Be a U.S. citizen;
2. Be lawfully admitted for permanent residence and seeking citizenship as outlined in 8 U.S.C. 1324b(a)(3)(B);
3. Be (i) admitted as a refugee under 8 U.S.C. 1157 or granted asylum under 8 U.S.C. 1158 and (ii) have filed a declaration of intention to become a lawful permanent resident and then a citizen when eligible; or
4. Owe allegiance to the U.S. (i.e., qualify as a non-citizen U.S. national under federal law).
Employment is contingent on background / security investigation results.
BENEFITS AT-A-GLANCE
The SAA provides a highly competitive benefitspackage for all SAA staff. Our benefits extend beyond health care coverage tohelp provide employees with student loan reimbursement, professionaldevelopment, transportation subsidy, TSP/retirement savings, access to ourEmployee Assistance Program, and more! For more information regarding SAA'sbenefits, please visit https://sen.gov/OPPW.
ACCOMMODATIONS
As an Equal Opportunity Employer, the SAA is committed to providing reasonable accommodations to applicants with disabilities. If you are interested in applying for employment with SAA and need special assistance or an accommodation to complete the application process, please submit your request to employment@saa.senate.gov email with "Accommodation" in the subject line.
VOLUNTARY SELF-IDENTIFICATION FOR VETERANS' PREFERENCE
If you are identifying as veterans' preference eligible underthe VEOA, please use this link to complete your application for Veterans' Preference AFTER you apply for this position. The link will also be available on the "Thank You" page after you have submitted your job application.
Candidates only need to apply one time for veterans' preference tobe considered for all future veterans' preference positions within the SenateSergeant at Arms.
- All supporting documents must ONLY be provided within the Veterans' Preference Application and within the stated deadline of the job announcement.
- Late applications for veterans' preference will not be considered.
- Documentation to obtain veterans' preference will not be considered if attached to the job application.
- If you need to revise or resubmit your Application for Veterans' Preference/documents, please withdraw your previous Application for Veterans' Preference and resubmit. If you require assistance, please email employment@saa.senate.gov.
- mailto:employment@saa.senate.gov="">To view additional information regarding the VEOA, please click here.
An applicantwho declines to self-identify as a disabled veteran and/or to provideinformation and documentation regarding his/her disabled veteran's status willnot be subjected to an adverse employment action, but the individual may beruled ineligible for veterans'preference.