Skip to content

SXT bugfixes and improvements#801

Open
stephen-riggs wants to merge 15 commits into
mainfrom
sxt-round2
Open

SXT bugfixes and improvements#801
stephen-riggs wants to merge 15 commits into
mainfrom
sxt-round2

Conversation

@stephen-riggs
Copy link
Copy Markdown
Contributor

@stephen-riggs stephen-riggs commented May 15, 2026

Various changes needed to make the SXT workflow smoother:

  • Use olefile directly and remove the txrm2tiff dependency
  • Read energy, tilt limits and tilt count from the txrm metadata and store them in the DataCollection ispyb table
  • Skip processing of reference txrm files
  • Allow processing of nested folders
  • Set session file to None and then tag the DCG with the unaltered metadata path
  • Set the data collection comment as any part of the file name before _angle

The remaining issue is how to set the rsyncers correctly, which we need to discuss

@codecov
Copy link
Copy Markdown

codecov Bot commented May 18, 2026

Codecov Report

❌ Patch coverage is 68.62745% with 16 lines in your changes missing coverage. Please review.
✅ Project coverage is 52.34%. Comparing base (38088f7) to head (e23ed22).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #801   +/-   ##
=======================================
  Coverage   52.33%   52.34%           
=======================================
  Files          96       96           
  Lines       10324    10345   +21     
  Branches     1357     1363    +6     
=======================================
+ Hits         5403     5415   +12     
- Misses       4642     4647    +5     
- Partials      279      283    +4     
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@stephen-riggs stephen-riggs changed the title SXT fixes SXT bugfixes and improvements May 18, 2026
@stephen-riggs stephen-riggs marked this pull request as ready for review May 18, 2026 15:11
@stephen-riggs stephen-riggs requested review from d-j-hatton and tieneupin and removed request for tieneupin May 18, 2026 15:11
Comment thread src/murfey/client/contexts/sxt.py
Comment thread src/murfey/client/contexts/sxt.py
Comment thread src/murfey/client/contexts/sxt.py
Comment on lines +213 to +216
visit_index = transferred_file.parent.parts.index(environment.visit)
destination_search_dir = "/".join(
transferred_file.parent.parts[: visit_index + 2]
).replace("//", "/")
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.parent is not strictly needed, as the indexing and slicing should work the same on the original transferred_file variable.

Comment thread src/murfey/client/contexts/sxt.py Outdated
Copy link
Copy Markdown
Contributor

@tieneupin tieneupin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some requests for clarification, but beyond that, the changes looks good. Nice work!

txrm_ole.openstream("ImageInfo/PixelSize").getvalue(),
np.float32,
).tolist()
metadata["pixel_size"] = pixel_size_txrm[0] * 1e4
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you converting to micrometres here?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like I set it to go from microns to angstroms. That was done in a previous PR but I guess the txrm is storing it in microns then

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants