XY Input: Lora Block Weight¶
Documentation¶
- Class name:
XY Input: Lora Block Weight __Inspire - Category:
InspirePack/LoraBlockWeight - Output node:
False
This node is designed to process and visualize the weight of different blocks within a Lora model, facilitating an understanding of the model's internal representations through XY plotting. It enables users to compare and contrast the influence of various blocks, offering insights into the model's behavior and aiding in the optimization or interpretation of its workings.
Input types¶
Required¶
category_filter- Filters the analysis to specific categories, allowing for targeted exploration of block weights within the Lora model.
- Comfy dtype:
COMBO[STRING] - Python dtype:
list[str]
lora_name- unknown
- Comfy dtype:
COMBO[STRING] - Python dtype:
unknown
strength_model- Adjusts the model's strength parameter, influencing the impact of block weights on the overall analysis.
- Comfy dtype:
FLOAT - Python dtype:
float
strength_clip- Sets the clipping strength for block weights, refining the visualization by emphasizing more significant weights.
- Comfy dtype:
FLOAT - Python dtype:
float
inverse- Determines whether to invert the block weights, offering an alternative perspective on their influence.
- Comfy dtype:
BOOLEAN - Python dtype:
bool
seed- Provides a seed for random number generation, ensuring reproducibility of the analysis.
- Comfy dtype:
INT - Python dtype:
int
A- A parameter influencing the calculation of block weights, part of the model's internal configuration.
- Comfy dtype:
FLOAT - Python dtype:
float
B- Another parameter affecting the block weight calculation, contributing to the model's analytical depth.
- Comfy dtype:
FLOAT - Python dtype:
float
preset- Selects a preset configuration for the analysis, streamlining the setup process.
- Comfy dtype:
COMBO[STRING] - Python dtype:
str
block_vectors- Specifies the vectors representing blocks to be analyzed, directly impacting the visualization output.
- Comfy dtype:
STRING - Python dtype:
str
heatmap_palette- Chooses the color palette for the heatmap visualization, enhancing the interpretability of results.
- Comfy dtype:
COMBO[STRING] - Python dtype:
str
heatmap_alpha- Sets the opacity level for the heatmap, allowing for adjustable visualization clarity.
- Comfy dtype:
FLOAT - Python dtype:
float
heatmap_strength- Determines the intensity of the heatmap, affecting the visual distinction of block weights.
- Comfy dtype:
FLOAT - Python dtype:
float
xyplot_mode- Selects the mode for XY plotting, defining the visualization's structure and focus.
- Comfy dtype:
COMBO[STRING] - Python dtype:
str
Output types¶
X (vectors)- Comfy dtype:
XY - Outputs the vectors representing the analyzed blocks, ready for XY plotting and further analysis.
- Python dtype:
list[XY_Capsule]
- Comfy dtype:
Y (effect_compares)- Comfy dtype:
XY - Outputs the comparative effects of the analyzed blocks, facilitating a deeper understanding of their impact through visualization.
- Python dtype:
list[XY_Capsule]
- Comfy dtype:
Usage tips¶
- Infra type:
CPU - Common nodes: unknown
Source code¶
class XYInput_LoraBlockWeight:
@staticmethod
def resolve_vector_string(vector_string, preset_dict):
vector_string = vector_string.strip()
if vector_string in preset_dict:
return vector_string, preset_dict[vector_string]
vector_infos = vector_string.split(':')
if len(vector_infos) > 1:
return vector_infos[0], vector_infos[1]
elif len(vector_infos) > 0:
return vector_infos[0], vector_infos[0]
else:
return None, None
@classmethod
def INPUT_TYPES(cls):
preset = ["Preset"] # 20
preset += load_lbw_preset("lbw-preset.txt")
preset += load_lbw_preset("lbw-preset.custom.txt")
default_vectors = "SD-NONE/SD-ALL\nSD-ALL/SD-ALL\nSD-INS/SD-ALL\nSD-IND/SD-ALL\nSD-INALL/SD-ALL\nSD-MIDD/SD-ALL\nSD-MIDD0.2/SD-ALL\nSD-MIDD0.8/SD-ALL\nSD-MOUT/SD-ALL\nSD-OUTD/SD-ALL\nSD-OUTS/SD-ALL\nSD-OUTALL/SD-ALL"
lora_names = folder_paths.get_filename_list("loras")
lora_dirs = [os.path.dirname(name) for name in lora_names]
lora_dirs = ["All"] + list(set(lora_dirs))
return {"required": {
"category_filter": (lora_dirs, ),
"lora_name": (lora_names, ),
"strength_model": ("FLOAT", {"default": 1.0, "min": -10.0, "max": 10.0, "step": 0.01}),
"strength_clip": ("FLOAT", {"default": 1.0, "min": -10.0, "max": 10.0, "step": 0.01}),
"inverse": ("BOOLEAN", {"default": False, "label_on": "True", "label_off": "False"}),
"seed": ("INT", {"default": 0, "min": 0, "max": 0xffffffffffffffff}),
"A": ("FLOAT", {"default": 1.0, "min": -10.0, "max": 10.0, "step": 0.01}),
"B": ("FLOAT", {"default": 1.0, "min": -10.0, "max": 10.0, "step": 0.01}),
"preset": (preset,),
"block_vectors": ("STRING", {"multiline": True, "default": default_vectors, "placeholder": "{target vector}/{reference vector}", "pysssss.autocomplete": False}),
"heatmap_palette": (["viridis", "magma", "plasma", "inferno", "cividis"], ),
"heatmap_alpha": ("FLOAT", {"default": 0.8, "min": 0.0, "max": 1.0, "step": 0.01}),
"heatmap_strength": ("FLOAT", {"default": 1.5, "min": 0.0, "max": 10.0, "step": 0.01}),
"xyplot_mode": (["Simple", "Diff", "Diff+Heatmap"],),
}}
RETURN_TYPES = ("XY", "XY")
RETURN_NAMES = ("X (vectors)", "Y (effect_compares)")
FUNCTION = "doit"
CATEGORY = "InspirePack/LoraBlockWeight"
def doit(self, lora_name, strength_model, strength_clip, inverse, seed, A, B, preset, block_vectors, heatmap_palette, heatmap_alpha, heatmap_strength, xyplot_mode, category_filter=None):
xy_type = "XY_Capsule"
preset_dict = load_preset_dict()
common_params = lora_name, strength_model, strength_clip, inverse, block_vectors, seed, A, B, heatmap_palette, heatmap_alpha, heatmap_strength, xyplot_mode
storage = {}
x_values = []
x_idx = 0
for block_vector in block_vectors.split("\n"):
if block_vector == "":
continue
item = block_vector.split('/')
if len(item) > 0:
target_vector = item[0].strip()
ref_vector = item[1].strip() if len(item) > 1 else ''
x_item = None
label, block_vector = XYInput_LoraBlockWeight.resolve_vector_string(target_vector, preset_dict)
_, ref_block_vector = XYInput_LoraBlockWeight.resolve_vector_string(ref_vector, preset_dict)
if label is not None:
x_item = XY_Capsule_LoraBlockWeight(x_idx, 0, block_vector, label, storage, common_params)
x_idx += 1
if x_item is not None and ref_block_vector is not None:
x_item.set_reference_vector(ref_block_vector)
if x_item is not None:
x_values.append(x_item)
if xyplot_mode == "Simple":
y_values = [XY_Capsule_LoraBlockWeight(0, 0, '', 'target', storage, common_params)]
elif xyplot_mode == "Diff":
y_values = [XY_Capsule_LoraBlockWeight(0, 0, '', 'target', storage, common_params),
XY_Capsule_LoraBlockWeight(0, 1, '', 'reference', storage, common_params),
XY_Capsule_LoraBlockWeight(0, 2, '', 'diff', storage, common_params)]
else:
y_values = [XY_Capsule_LoraBlockWeight(0, 0, '', 'target', storage, common_params),
XY_Capsule_LoraBlockWeight(0, 1, '', 'reference', storage, common_params),
XY_Capsule_LoraBlockWeight(0, 2, '', 'diff', storage, common_params),
XY_Capsule_LoraBlockWeight(0, 3, '', 'heatmap', storage, common_params)]
return ((xy_type, x_values), (xy_type, y_values), )