Share const tensor in graph #574
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
chxin66
force-pushed
the
md5
branch
10 times, most recently
from
47b3587 to
b7f4bd4
Compare
sunshinemyson
requested changes
Apr 12, 2023
chxin66
force-pushed
the
md5
branch
6 times, most recently
from
92b3eb3 to
b873cd0
Compare
sunshinemyson
changed the title
chxin66
force-pushed
the
md5
branch
3 times, most recently
from
723b6d6 to
0449485
Compare
sunshinemyson
requested changes
Apr 18, 2023
sunshinemyson
approved these changes
Apr 19, 2023
Tensor can be shared between different operations, if tensor have identical data and quantization parameter, they should share same low-level tensor object to save memory. In tim-vx, introduce a tensor cache which key is md5sum and value is low-level tensor object. If up-coming tensor have same md5sum, the cached tensor object reused for tensor creation. Type: New feature Signed-off-by: Chen Xin <[email protected]>
sunshinemyson
approved these changes
Apr 19, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Tensor with same md5 will be created once and shared
Type: New feature