Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: add mock source config api to test device mode sdk loading #1856

Merged
merged 2 commits into from
Jan 7, 2025

Conversation

koladilip
Copy link
Collaborator

@koladilip koladilip commented Jan 6, 2025

What are the changes introduced in this PR?

This creates a mock source API with device mode destinations to test loading of SDKs

What is the related Linear task?

Resolves INT-3081

Please explain the objectives of your changes below

Put down any required details on the broader aspect of your changes. If there are any dependent changes, mandatorily mention them here

Any changes to existing capabilities/behaviour, mention the reason & what are the changes ?

N/A

Any new dependencies introduced with this change?

N/A

Any new checks got introduced or modified in test suites. Please explain the changes.

N/A


Developer checklist

  • My code follows the style guidelines of this project

  • No breaking changes are being introduced.

  • All related docs linked with the PR?

  • All changes manually tested?

  • Any documentation changes needed with this change?

  • I have executed schemaGenerator tests and updated schema if needed

  • Are sensitive fields marked as secret in definition config?

  • My test cases and placeholders use only masked/sample values for sensitive fields

  • Is the PR limited to 10 file changes & one task?

Reviewer checklist

  • Is the type of change in the PR title appropriate as per the changes?

  • Verified that there are no credentials or confidential data exposed with the changes.

Summary by CodeRabbit

  • New Features

    • Added a utility function to filter languages based on destination configurations.
    • Created a dummy source configuration API server for testing SDKs.
  • Refactor

    • Moved language filtering logic to a common module.
    • Simplified language filtering implementation.
  • Chores

    • Updated import and export statements across multiple script files.

Copy link

coderabbitai bot commented Jan 6, 2025

Walkthrough

The changes involve modifications to three JavaScript files in the scripts directory. A new constant languageMap and a filterLanguages function are introduced in common.js to handle language filtering for different platforms. A new server script dummySourceConfigApiToTestSdKs.js is created to serve source configuration endpoints, and generateConstants.js is updated to import the filterLanguages function from the common module instead of defining it locally.

Changes

File Change Summary
scripts/common.js - Introduced languageMap constant for platform-language mapping
- Added filterLanguages(destination, langCode) function
- Updated module.exports to include filterLanguages
scripts/dummySourceConfigApiToTestSdKs.js - New file implementing HTTP server for source configuration
- Added functions: getJSDeviceModeDestinations(), getSourceConfig(writeKey), getAuthInfo(authHeader), setCorsHeaders(res)
scripts/generateConstants.js - Removed local filterLanguages function
- Imported filterLanguages from ./common module

Sequence Diagram

sequenceDiagram
    participant Client as HTTP Client
    participant Server as Source Config Server
    participant FileSystem as Destination Configs
    
    Client->>Server: HTTP Request
    Server->>Server: Extract Write Key
    Server->>FileSystem: Read Destination Configs
    FileSystem-->>Server: Return Config Files
    Server->>Server: Filter Destinations
    Server-->>Client: Return Source Configuration JSON
Loading

Poem

🐰 Hop, hop, code's new dance!
Language mapping with a glance
Servers spinning, configs bright
Filtering platforms with delight
CodeRabbit's magic takes its stance! 🚀


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit testing code for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and generate unit testing code.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR. (Beta)
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Nitpick comments (4)
scripts/common.js (2)

1-6: Consider a more descriptive identifier for languageMap.
While languageMap is adequately descriptive, consider selecting a name that conveys its purpose more clearly—e.g., platformLanguageMap. This makes the code more readable for new developers.


9-13: Ensure consistent handling when supportedConnectionModes is absent.
Currently, a warning is logged and false is returned. While this is acceptable, consider recording or tracking this missing configuration in a more robust way (for example, incrementing a metrics counter) to facilitate troubleshooting in larger codebases.

scripts/generateConstants.js (1)

4-4: Adopt a consistent import style to address ESLint warnings.
Your ESLint error suggests that you may need ES6 imports rather than require(). If your environment supports ES modules, consider using import { filterLanguages } from './common.js'; and update your configuration accordingly.

🧰 Tools
🪛 eslint

[error] 4-4: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)

scripts/dummySourceConfigApiToTestSdKs.js (1)

10-35: Consider caching when reading db-config.json files repeatedly.
Repeatedly reading and parsing the same JSON files could be inefficient if you expect a high request volume. Caching or reading once on startup can improve performance.

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 394585f and f6c580c.

📒 Files selected for processing (3)
  • scripts/common.js (1 hunks)
  • scripts/dummySourceConfigApiToTestSdKs.js (1 hunks)
  • scripts/generateConstants.js (1 hunks)
🧰 Additional context used
🪛 eslint
scripts/generateConstants.js

[error] 4-4: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)

scripts/dummySourceConfigApiToTestSdKs.js

[error] 2-2: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 3-3: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 4-4: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 5-5: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 6-6: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)

🔇 Additional comments (1)
scripts/common.js (1)

17-23: Validate unknown platforms before checking languageMap[platform].
The optional chaining prevents runtime errors; however, you might consider logging unrecognized platforms to detect invalid configurations.

Here is a possible snippet to verify if any platform is missing from languageMap:

scripts/dummySourceConfigApiToTestSdKs.js Outdated Show resolved Hide resolved
scripts/dummySourceConfigApiToTestSdKs.js Outdated Show resolved Hide resolved
Copy link

codecov bot commented Jan 6, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 100.00%. Comparing base (394585f) to head (955c94e).
Report is 1 commits behind head on develop.

Additional details and impacted files
@@            Coverage Diff            @@
##           develop     #1856   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files            2         2           
  Lines           53        53           
  Branches         7         7           
=========================================
  Hits            53        53           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Nitpick comments (6)
scripts/dummySourceConfigApiToTestSdKs.js (6)

37-37: Consider lazy loading of destinations.

The destinations are loaded and cached at startup. For a test server, this might be fine, but consider implementing lazy loading or periodic refresh if the configurations need to be updated during runtime.


39-62: Document the mock configuration structure.

Consider adding JSDoc comments to document the expected structure and purpose of the mock configuration. This will help other developers understand what this test configuration represents.

Example:

+/**
+ * Generates a mock source configuration for testing device mode SDK loading.
+ * @param {string} writeKey - The write key to include in the configuration
+ * @returns {Object} A mock source configuration object matching the production schema
+ */
 const getSourceConfig = (writeKey) => ({

103-104: Improve auth info handling.

The current implementation mixes auth sources without clear precedence rules.

Consider this improvement:

-  const authInfo = getAuthInfo(authHeader);
-  const writeKey = authInfo?.username || query.writeKey;
+  const authInfo = getAuthInfo(authHeader);
+  if (authInfo.error) {
+    console.warn(`Auth validation failed: ${authInfo.error}`);
+  }
+  // Prefer auth header over query param
+  const writeKey = authInfo.username || query.writeKey;

79-83: Document CORS configuration decisions.

The current CORS configuration allows all origins, which is fine for testing but should be documented as a test-only configuration.

Add a comment explaining the permissive CORS setup:

 function setCorsHeaders(res) {
+  // Note: Permissive CORS configuration for testing purposes only
+  // Do not use this configuration in production
   res.setHeader('Access-Control-Allow-Origin', '*');

86-111: Add request timeout and error handling.

The server implementation could benefit from additional error handling and timeouts.

Consider these improvements:

 const server = http.createServer((req, res) => {
+  // Set a timeout for all requests
+  req.setTimeout(5000, () => {
+    res.writeHead(408);
+    res.end('Request timeout');
+  });
+
+  // Handle request errors
+  req.on('error', (error) => {
+    console.error('Request error:', error);
+    res.writeHead(500);
+    res.end('Internal server error');
+  });

   // Rest of the implementation...
 });

113-117: Add graceful shutdown handling.

The server should handle shutdown signals to close existing connections gracefully.

Add this after the server creation:

process.on('SIGTERM', () => {
  console.log('Received SIGTERM. Performing graceful shutdown...');
  server.close(() => {
    console.log('Server closed');
    process.exit(0);
  });
});
📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between f6c580c and 955c94e.

📒 Files selected for processing (1)
  • scripts/dummySourceConfigApiToTestSdKs.js (1 hunks)
🧰 Additional context used
🪛 eslint
scripts/dummySourceConfigApiToTestSdKs.js

[error] 2-2: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 3-3: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 4-4: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 5-5: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 6-6: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)

🔇 Additional comments (1)
scripts/dummySourceConfigApiToTestSdKs.js (1)

1-9: LGTM! Module imports and path handling look good.

The code correctly uses path.join for cross-platform path handling and properly imports required modules.

🧰 Tools
🪛 eslint

[error] 2-2: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 3-3: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 4-4: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 5-5: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)


[error] 6-6: Require statement not part of import statement.

(@typescript-eslint/no-var-requires)

scripts/dummySourceConfigApiToTestSdKs.js Show resolved Hide resolved
scripts/dummySourceConfigApiToTestSdKs.js Show resolved Hide resolved
@koladilip koladilip merged commit 1b1540e into develop Jan 7, 2025
15 checks passed
@koladilip koladilip deleted the chore/add-mock-source-config-api branch January 7, 2025 06:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants