Sr. Splunk Systems Engineer

Overview

Senior Splunk Systems Engineer

Intuit’s Workforce Technology department is tasked with building, securing and operating Intuit’s core IT functions for our global workforce. We enable our employees to do the best work of their lives by providing resilient and innovative technology solutions.

We’re looking for a talented individual to join our Systems Engineering team as a Senior level engineer with very strong Splunk and Systems Engineering experience & knowledge. This is a fantastic opportunity to join a well-established company and be part of a highly progressive and transformative IT team. You will work closely with system architects and various infrastructure team leaders to support Intuit’s enterprise Splunk and Hosting implementation. Overall, your responsibilities will be focused on the design, management, and support aspects of the Splunk/Hosting environment. Intuit’s Splunk/Hosting supports the corporate workforce and our mission critical production environment. It is essential that services such as Splunk and Hosting be maintained at the highest levels. Ensuring the security, integrity, and availability of Splunk, Nutanix, VMWare, System Center Suite, file/print services, DHCP, and other systems engineering related services are considered key responsibilities for this role.

Responsibilities

Essential Duties and Responsibilities:

Primary focus is technical leadership in the planning, designing, implementing, and supporting Intuit’s Splunk Infrastructure.

Design, develop, configure, and implement solutions for a large-scale enterprise Splunk environments Develop Best Practices to maximize the use of Splunk Administer Splunk and Splunk Applications for Enterprise Security (ES) log management.

Troubleshoot Splunk server and agent problems and issues. Perform data mining and analysis, utilizing various queries and reporting methods

Ensure thorough testing of solutions for functionality and compatibility.

Communicate, document, and distill technical information to team members and partner organizations.

Diagnoses And Troubleshoots Complex Technical Issues

• Lead the design, implementation and support of a highly available infrastructure platform.
• Implementation experience with high security Splunk and Hosting environments
• Engineer, assess, and review future Splunk and Hosting architecture solutions, 3rd party management tools/applications and implement life cycle maintenance processes.
• Provide Splunk technical and project leadership across a diverse team for multiple platforms, programs and projects.
• Provide capacity planning and performance monitoring to sustain and improve service availability.
• Coordinate service/support needs with vendors, application support teams, and internal teams through effective partnership, collaboration and communication.
• Provide Change Request leadership for the deployment of application or infrastructure related changes.
• Provide 3rd level operations support for Splunk and Hosting for end users, application and administration teams. You must be comfortable in addressing critical incidents.
• Participate in security and application troubleshooting and incident problem resolutions with other infrastructure teams, including application, storage, Splunk/Hosting, and server teams.
• Brief/present to senior leadership on the status of projects and tasks.
• All other duties as assigned are required for the role
• On-call operations duties and rotations

Qualifications

Required Qualifications

B. S. in Computer Science or equivalent

Splunk Certified Architect Certification

5-10 years of experience in deploying Splunk in a large enterprise environment (15,000+ Users) and architecting, configuring, deploying, and customizing Splunk.

Splunk – Must be able to scope, size, deploy and manage a Splunk on-prem instance for a large enterprise.

Skilled in Splunk log source integration, use case development and implementation

Strong understanding of Splunk configuration files and architecture

Very Strong Linux Administration Skills/experience.

Knowledge of advanced search and reporting commands

Demonstrated ability to create complex dashboards, forms, and visualizations for messaging, hosting, networking, video, voice, and other infrastructure technologies

Experience in the operations, management, monitoring and maintenance of enterprise applications, servers and network technologies.

Understanding of system log files and other structured and non-structured data

Strong Regex experience and ability to define source types

Ability To Develop Scripts To Automate, Reduce Administrative/maintenance Efforts

• Understanding of System Log Files and other structured and non-structured data.
• Extensive experience with Windows Server 2012/2016.
• Strong PowerShell and VBS scripting expertise
• Ability to establish best practices for monitoring system/application capacity.
• Working knowledge of one or more virtualization technologies required (such as VMWare, Hyper-V).
• Excellent written and verbal communication skills.
• Must be a self-starter with the ability to work independently and in a collaborative team environment.
• Capable of effectively managing relationships with internal and external partners. Excellent time management and organizational skills.

Preferred Experience

• Splunk Certified Architect certification.
• Very proficient at linux administration.
• Red Hat Certified Engineer certification.
• AWS Certification.
• Strong technical project management skills
• Hands-on experience using scripts and scripting languages such as Powershell, VB Script, Python, Java, or Perl to deploy, manage, and automate device configurations and monitoring/reporting tools & alerting.
• Experience working with AWS, Azure, or GCE
• Solid understanding of IT components including Networking, Network Load Balancing, SAN/NAS storage, Single Sign-On solutions, and SaaS Solutions (Box, AWS, etc)
• Microsoft or equivalent certifications a plus

The Successful Candidate Will Exhibit The Following Traits

• Analytic Ability: Makes well-reasoned, appropriate decisions based on analysis of highly uncertain input or outcomes; Integrates information from a variety of sources, quickly, to arrive at a broad understanding of issues; Approaches problems or issues systematically, looking for connections, trends and potential causes.
• Business Results Orientation: Anticipates and addresses obstacles, redirecting efforts to accelerate work or improve quality while achieving results in a timely manner; Surfaces problems, issues and solutions with speed and accuracy; Holds self and team accountable for outcome.
• Communication: Prepares and delivers coherent, highly credible and engaging presentations that have impact; Writes technical concepts and information clearly and thoroughly for technical and non-technical audiences; tailors communication style and content to the audience.
• Creativity & Innovation: Demonstrates initiative, creativity and innovation to drive more effective design and process ideas to fruition within or outside their area of discipline; Demonstrates an entrepreneurial perspective by envisioning, aggressively pursuing, new and innovative ideas and approaches to achieve business unit objectives; Leverages leading-edge technologies, processes, tools and practices to contribute to the organizations future.
• Decision Making: Chooses the best alternative(s) based on a review of pros, cons, trade-offs, timing and implications; Evaluates the consequences and implications of alternatives, actions or decisions at a work group level; Makes timely decisions on problems/issues requiring immediate attention. Supports the speed and quality of decision making.
• Organization Influence & Relationship Management: Proactively builds a broad base of support among key decision-makers and influencers; Advocates for positions firmly, but appropriately, without pushing or compromising positions too much; Presents a persuasive rationale for positions; Deep customer empathy – listening to customer, establishing long standing relationship and trust. Follow through to customer resolution; maintains customer satisfaction and loyalty; Gathers and internalizes rich customer feedback, using it to generate innovative solutions that fill core or future needs; Addresses customer needs by involving the right people at the right time.
• Learning Ability: Demonstrates flexibility and resilience in response to obstacles, constraints, adversity and mistakes; Seeks opportunities to learn from new discoveries, innovations, ideas and ways of looking at things; readily and resourcefully adapts to changing needs, conditions, priorities and opportunities.
• Prioritization: Prioritizes and balances time, actions, resources and initiatives to ensure achievement of critical goals; Aligns cross functional self and team priorities based on changing needs
• Process Orientation: Author / Designer of procedures. Applies situational judgment and teaches others. Confident in escalating when process is broken or inefficient and makes recommendations on how to resolve
• Teamwork: Builds relationships with people across disciplines and functions, throughout the organization; involves others as appropriate when issues affect them. Resolves conflict; Builds collaboration by identifying and conveying common interests and priorities (including removal of barriers and breaking down silos); Inspires, energizes, motivates and draws out the best work from a cross-functional team; Ensures that positions satisfy the needs, interests and concerns of key stakeholders; Mentors and coaches colleagues, builds partnerships across organizational boundaries while resolving resource conflicts