Head of Search Quality — International Search Platform (NDA)

January 2016–March 2019 · Amsterdam, Netherlands · Full-time · Primary employment during this period

The employer's name is withheld under an NDA. This was Olena’s primary full-time position from January 2016 to March 2019. Confidential products, internal methods, team information, client data and nonpublic metrics are not disclosed.

• Lead the search quality function responsible for the relevance, accuracy, completeness, and usefulness of search results.
• Establish strategy and procedures for relevance evaluation, ranking quality monitoring, and documentation of search product changes.
• Organize the work of Search Quality specialists and analytics, product, engineering, and research teams. Align search evaluation priorities.
• Develop approaches to manual and automated relevance assessment. Study queries, audience intent, and the causes of unsatisfactory results.
• Work with NDCG, MRR, Precision, Recall, CTR, and Search Success Rate, experimentation frameworks, qualitative assessments, and user experience signals, as stated in her professional profile.
• Analyze search logs, user journeys, segments, search failures, and feedback to improve discoverability and user satisfaction.
• Work with ML/Data Science and technical specialists on semantic search, Learning to Rank, recommender systems, and experimental assessment of improvements. Do not disclose proprietary solutions or internal architectures.
• Manage release quality validation and monitoring of changes to search behavior.

Nature of the results: Led a complex cross-functional search quality operation. Exact commercial or algorithmic KPIs are not published because of the NDA and the absence of approved disclosures.