English summary for screening — check the original posting before applying.
Stockmark Inc. is seeking a RAG/Search Infrastructure Engineer to enhance the RAG and search capabilities of their AI agent product, Aconnect. This role involves improving infrastructure and backend services for a commercial product handling large-scale data, contributing to the initial growth phase of AI agents.
Must-haves
- Experience building and operating search engines like OpenSearch (including data and index structures).
- Experience with cloud platforms (AWS/GCP/Azure).
- Experience in performance investigation and improvement of databases.
- Experience implementing batch processing for data handling.
- Minimum 1 year of continuous development and operation experience for a single service/product.
- Must be able to reside in Japan.
- Must be able to communicate smoothly in Japanese (technical details included).
Nice-to-haves
- Experience implementing vector databases or vector computation processing.
- Experience building and operating RAG systems.
- Experience in improving search performance (e.g., refining search algorithms, quantitative evaluation of search accuracy).
- Experience in product development and improvement through collaboration with PdMs and business members.
Tech stack
OpenSearchPythonRubyAWSVectorDBRuby on RailsVue.jsTypeScriptFlutterTerraformAurora MySQLDynamoDBRedisECSLambdaStep FunctionsBatchEMR ServerlessBedrockCognitoSNSSQSSESIAMCodeBuildCodePipelineCodeDeployOpenAIAzure OpenAI ServiceIn-house LLMAWS BedrockTransformersvLLMDatadogSentrySendGrid
Work style
Full remote work possible. Residency must be within Japan. Employees can choose between remote and office work. Commuting to the Head Office in Minato-ku, Tokyo is optional.
Other notes
Monthly Salary: ¥584,000 - ¥1,250,000. Estimated Annual Salary: ¥7,008,000 - ¥15,000,000. Salary increases twice a year. Flextime system (Core time: 10:00 - 14:00). 123 days off per year. Probationary period: 3 months.