Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bump: transmission to use neptune only, drop neptune-client #19265

Merged
merged 18 commits into from
Feb 16, 2024
Merged

Conversation

Borda
Copy link
Member

@Borda Borda commented Jan 10, 2024

What does this PR do?

With the next feari=ure release let's cut and exclusively support neptune and drop legacy neptune-client, see: #19131 (comment)

Before submitting
  • Was this discussed/agreed via a GitHub issue? (not for typos and docs)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure your PR does only one thing, instead of bundling different changes together?
  • Did you make sure to update the documentation with your changes? (if necessary)
  • Did you write any new necessary tests? (not for typos and docs)
  • Did you verify new and existing tests pass locally with your changes?
  • Did you list all the breaking changes introduced by this pull request?
  • Did you update the CHANGELOG? (not for typos, docs, test updates, or minor internal changes/refactors)

PR review

Anyone in the community is welcome to review the PR.
Before you start reviewing, make sure you have read the review guidelines. In short, see the following bullet-list:

Reviewer checklist
  • Is this pull request ready for review? (if not, please submit in draft mode)
  • Check that all items from Before submitting are resolved
  • Make sure the title is self-explanatory and the description concisely explains the PR
  • Add labels and milestones (and optionally projects) to the PR so it can be classified

📚 Documentation preview 📚: https://pytorch-lightning--19265.org.readthedocs.build/en/19265/

cc @Borda

@github-actions github-actions bot added pl Generic label for PyTorch Lightning package dependencies Pull requests that update a dependency file labels Jan 10, 2024
Copy link
Contributor

github-actions bot commented Jan 10, 2024

⚡ Required checks status: All passing 🟢

Groups summary

🟢 pytorch_lightning: Tests workflow
Check ID Status
pl-cpu (macOS-11, lightning, 3.8, 1.13, oldest) success
pl-cpu (macOS-11, lightning, 3.10, 1.13) success
pl-cpu (macOS-11, lightning, 3.10, 2.1) success
pl-cpu (macOS-11, lightning, 3.10, 2.2) success
pl-cpu (ubuntu-20.04, lightning, 3.8, 1.13, oldest) success
pl-cpu (ubuntu-20.04, lightning, 3.10, 1.13) success
pl-cpu (ubuntu-20.04, lightning, 3.10, 2.1) success
pl-cpu (ubuntu-20.04, lightning, 3.10, 2.2) success
pl-cpu (windows-2022, lightning, 3.8, 1.13, oldest) success
pl-cpu (windows-2022, lightning, 3.10, 1.13) success
pl-cpu (windows-2022, lightning, 3.10, 2.1) success
pl-cpu (windows-2022, lightning, 3.10, 2.2) success
pl-cpu (macOS-11, pytorch, 3.8, 1.13) success
pl-cpu (ubuntu-20.04, pytorch, 3.8, 1.13) success
pl-cpu (windows-2022, pytorch, 3.8, 1.13) success
pl-cpu (macOS-12, pytorch, 3.11, 2.0) success
pl-cpu (macOS-12, pytorch, 3.11, 2.1) success
pl-cpu (ubuntu-22.04, pytorch, 3.11, 2.0) success
pl-cpu (ubuntu-22.04, pytorch, 3.11, 2.1) success
pl-cpu (windows-2022, pytorch, 3.11, 2.0) success
pl-cpu (windows-2022, pytorch, 3.11, 2.1) success

These checks are required after the changes to requirements/pytorch/loggers.info, src/lightning/pytorch/loggers/neptune.py.

🟢 pytorch_lightning: Azure GPU
Check ID Status
pytorch-lightning (GPUs) (testing Lightning | latest) success
pytorch-lightning (GPUs) (testing PyTorch | latest) success

These checks are required after the changes to requirements/pytorch/loggers.info, src/lightning/pytorch/loggers/neptune.py.

🟢 pytorch_lightning: Benchmarks
Check ID Status
lightning.Benchmarks success

These checks are required after the changes to requirements/pytorch/loggers.info, src/lightning/pytorch/loggers/neptune.py.

🟢 pytorch_lightning: Docs
Check ID Status
docs-make (pytorch, doctest) success
docs-make (pytorch, html) success

These checks are required after the changes to src/lightning/pytorch/loggers/neptune.py, requirements/pytorch/loggers.info.

🟢 pytorch_lightning: Docker
Check ID Status
build-cuda (3.9, 1.13, 11.8.0) success
build-cuda (3.9, 1.13, 12.0.1) success
build-cuda (3.10, 2.0, 11.8.0) success
build-cuda (3.10, 2.1, 12.1.0) success
build-pl (3.9, 1.13, 11.8.0) success
build-pl (3.9, 1.13, 12.0.1) success
build-pl (3.10, 2.0, 11.8.0) success
build-pl (3.10, 2.1, 12.1.0) success

These checks are required after the changes to requirements/pytorch/loggers.info.

🟢 mypy
Check ID Status
mypy success

These checks are required after the changes to requirements/pytorch/loggers.info, src/lightning/pytorch/loggers/neptune.py.

🟢 install
Check ID Status
install-pkg (ubuntu-22.04, app, 3.8) success
install-pkg (ubuntu-22.04, app, 3.11) success
install-pkg (ubuntu-22.04, fabric, 3.8) success
install-pkg (ubuntu-22.04, fabric, 3.11) success
install-pkg (ubuntu-22.04, pytorch, 3.8) success
install-pkg (ubuntu-22.04, pytorch, 3.11) success
install-pkg (ubuntu-22.04, lightning, 3.8) success
install-pkg (ubuntu-22.04, lightning, 3.11) success
install-pkg (ubuntu-22.04, notset, 3.8) success
install-pkg (ubuntu-22.04, notset, 3.11) success
install-pkg (macOS-12, app, 3.8) success
install-pkg (macOS-12, app, 3.11) success
install-pkg (macOS-12, fabric, 3.8) success
install-pkg (macOS-12, fabric, 3.11) success
install-pkg (macOS-12, pytorch, 3.8) success
install-pkg (macOS-12, pytorch, 3.11) success
install-pkg (macOS-12, lightning, 3.8) success
install-pkg (macOS-12, lightning, 3.11) success
install-pkg (macOS-12, notset, 3.8) success
install-pkg (macOS-12, notset, 3.11) success
install-pkg (windows-2022, app, 3.8) success
install-pkg (windows-2022, app, 3.11) success
install-pkg (windows-2022, fabric, 3.8) success
install-pkg (windows-2022, fabric, 3.11) success
install-pkg (windows-2022, pytorch, 3.8) success
install-pkg (windows-2022, pytorch, 3.11) success
install-pkg (windows-2022, lightning, 3.8) success
install-pkg (windows-2022, lightning, 3.11) success
install-pkg (windows-2022, notset, 3.8) success
install-pkg (windows-2022, notset, 3.11) success

These checks are required after the changes to src/lightning/pytorch/loggers/neptune.py, requirements/pytorch/loggers.info.


Thank you for your contribution! 💜

Note
This comment is automatically generated and updates for 60 minutes every 180 seconds. If you have any other questions, contact carmocca for help.

Copy link

codecov bot commented Jan 10, 2024

Codecov Report

Merging #19265 (b547287) into master (61ba180) will decrease coverage by 35%.
Report is 1 commits behind head on master.
The diff coverage is 100%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #19265      +/-   ##
==========================================
- Coverage      84%      48%     -35%     
==========================================
  Files         450      442       -8     
  Lines       38105    37936     -169     
==========================================
- Hits        31871    18378   -13493     
- Misses       6234    19558   +13324     

@Borda Borda changed the title bump: min version neptune>=1.0.0 bump: transmission to use neptune only, drop neptune-client Jan 10, 2024
@awaelchli
Copy link
Contributor

@Borda take a look a the response here from @SiddhantSadangi from the neptune team: #18558 (comment)

@Borda
Copy link
Member Author

Borda commented Jan 11, 2024

@Borda take a look a the response here from @SiddhantSadangi from the neptune team: #18558 (comment)

Yes, the response was half a year ago, but still, if they support it, the API switch is for legacy Neptune-client, so the API in the new versions is the same I beilve we can cut Neptune-client<1.0

@Borda
Copy link
Member Author

Borda commented Jan 11, 2024

so with installing neptune==1.8.6 and asking import check

>>> import neptune
>>> from lightning_utilities.core.imports import RequirementCache
>>> RequirementCache("neptune>=1.0")
Requirement 'neptune>=1.0' met

then install the same neptune-client==1.8.6 and doing the same

>>> import neptune
>>> from lightning_utilities.core.imports import RequirementCache
>>> RequirementCache("neptune>=1.0")
	DistributionNotFound: The 'neptune>=1.0' distribution was not found and is required by the application. HINT: Try running `pip install -U 'neptune>=1.0'`
>>> from lightning_utilities.core.imports import module_available
>>> module_available("neptune")
True

@Lightning-AI Lightning-AI deleted a comment from gitguardian bot Jan 16, 2024
@Lightning-AI Lightning-AI deleted a comment from gitguardian bot Jan 18, 2024
Copy link

gitguardian bot commented Jan 19, 2024

⚠️ GitGuardian has uncovered 4 secrets following the scan of your pull request.

Please consider investigating the findings and remediating the incidents. Failure to do so may lead to compromising the associated services or software components.

🔎 Detected hardcoded secrets in your pull request
GitGuardian id GitGuardian status Secret Commit Filename
5685611 Triggered Generic High Entropy Secret 18eeab9 tests/tests_data/streaming/test_resolver.py View secret
5685611 Triggered Generic High Entropy Secret 18eeab9 tests/tests_data/streaming/test_resolver.py View secret
5685611 Triggered Generic High Entropy Secret 18eeab9 tests/tests_data/streaming/test_resolver.py View secret
5685611 Triggered Generic High Entropy Secret 18eeab9 tests/tests_data/streaming/test_resolver.py View secret
🛠 Guidelines to remediate hardcoded secrets
  1. Understand the implications of revoking this secret by investigating where it is used in your code.
  2. Replace and store your secret safely. Learn here the best practices.
  3. Revoke and rotate this secret.
  4. If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data.

To avoid such incidents in the future consider


🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.

Our GitHub checks need improvements? Share your feedbacks!

src/lightning/pytorch/loggers/neptune.py Outdated Show resolved Hide resolved
@awaelchli awaelchli added this to the 2.3 milestone Feb 15, 2024
src/lightning/pytorch/loggers/neptune.py Outdated Show resolved Hide resolved
@mergify mergify bot added the ready PRs ready to be merged label Feb 15, 2024
@Raalsky
Copy link
Contributor

Raalsky commented Feb 16, 2024

Thanks @Borda for handling this 😉. LGTM 🚀 . We should probably mention this PR here as well: #18555 as it's not going to be fixed according to these PR. We're going to send some communication to our clients about the discontinuation of this support.

I'll rebase all my PRs soon after merge of this one 😉.

@Borda
Copy link
Member Author

Borda commented Feb 16, 2024

We're going to send some communication to our clients about the discontinuation of this support.

sounds good; there is a long runway as this will be part of 2.3 so in a few months 🏃

@Borda Borda merged commit 6497e36 into master Feb 16, 2024
99 of 100 checks passed
@Borda Borda deleted the logger/neptune branch February 16, 2024 16:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file logger: neptune pl Generic label for PyTorch Lightning package ready PRs ready to be merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants