deepmd.utils package
Submodules
deepmd.utils.argcheck module
- class deepmd.utils.argcheck.ArgsPlugin[source]
Bases:
object
Methods
get_all_argument
([exclude_hybrid])Get all arguments.
register
(name[, alias])Regiester a descriptor argument plugin.
- get_all_argument(exclude_hybrid: bool = False) List[dargs.dargs.Argument] [source]
Get all arguments.
deepmd.utils.batch_size module
- class deepmd.utils.batch_size.AutoBatchSize(initial_batch_size: int = 1024, factor: float = 2.0)[source]
Bases:
object
This class allows DeePMD-kit to automatically decide the maximum batch size that will not cause an OOM error.
- Parameters
Notes
We assume all OOM error will raise
OutOfMemoryError
.- Attributes
Methods
execute
(callable, start_index, natoms)Excuate a method with given batch size.
execute_all
(callable, total_size, natoms, ...)Excuate a method with all given data.
- execute(callable: Callable, start_index: int, natoms: int) Tuple[int, tuple] [source]
Excuate a method with given batch size.
- Parameters
- Returns
- Raises
OutOfMemoryError
OOM when batch size is 1
deepmd.utils.compat module
Module providing compatibility between 0.x.x and 1.x.x input versions.
- deepmd.utils.compat.convert_input_v0_v1(jdata: Dict[str, Any], warning: bool = True, dump: Optional[Union[str, pathlib.Path]] = None) Dict[str, Any] [source]
Convert input from v0 format to v1.
- deepmd.utils.compat.convert_input_v1_v2(jdata: Dict[str, Any], warning: bool = True, dump: Optional[Union[str, pathlib.Path]] = None) Dict[str, Any] [source]
- deepmd.utils.compat.deprecate_numb_test(jdata: Dict[str, Any], warning: bool = True, dump: Optional[Union[str, pathlib.Path]] = None) Dict[str, Any] [source]
Deprecate numb_test since v2.1. It has taken no effect since v2.0.
See #1243.
deepmd.utils.convert module
- deepmd.utils.convert.convert_012_to_21(input_model: str, output_model: str)[source]
Convert DP 0.12 graph to 2.1 graph.
- deepmd.utils.convert.convert_10_to_21(input_model: str, output_model: str)[source]
Convert DP 1.0 graph to 2.1 graph.
- deepmd.utils.convert.convert_12_to_21(input_model: str, output_model: str)[source]
Convert DP 1.2 graph to 2.1 graph.
- deepmd.utils.convert.convert_13_to_21(input_model: str, output_model: str)[source]
Convert DP 1.3 graph to 2.1 graph.
- deepmd.utils.convert.convert_20_to_21(input_model: str, output_model: str)[source]
Convert DP 2.0 graph to 2.1 graph.
- deepmd.utils.convert.convert_dp012_to_dp10(file: str)[source]
Convert DP 1.0 graph text to 1.1 graph text.
- Parameters
- file
str
filename of the graph text
- file
- deepmd.utils.convert.convert_dp10_to_dp11(file: str)[source]
Convert DP 1.0 graph text to 1.1 graph text.
- Parameters
- file
str
filename of the graph text
- file
- deepmd.utils.convert.convert_dp12_to_dp13(file: str)[source]
Convert DP 1.2 graph text to 1.3 graph text.
- Parameters
- file
str
filename of the graph text
- file
- deepmd.utils.convert.convert_dp13_to_dp20(fname: str)[source]
Convert DP 1.3 graph text to 2.0 graph text.
- Parameters
- file
str
filename of the graph text
- file
deepmd.utils.data module
- class deepmd.utils.data.DataSets(sys_path, set_prefix, seed=None, shuffle_test=True)[source]
Bases:
object
Outdated class for one data system.
Deprecated since version 2.0.0: This class is not maintained any more.
Methods
get_batch
(batch_size)returned property prefector [4] in order: energy, force, virial, atom_ener
get_test
()returned property prefector [4] in order: energy, force, virial, atom_ener
load_energy
(set_name, nframes, nvalues, ...)return : coeff_ener, ener, coeff_atom_ener, atom_ener
check_batch_size
check_test_size
get_ener
get_natoms
get_natoms_2
get_natoms_vec
get_numb_set
get_set
get_sys_numb_batch
get_type_map
load_batch_set
load_data
load_set
load_test_set
load_type
load_type_map
numb_aparam
numb_fparam
reset_iter
set_numb_batch
stats_energy
- get_batch(batch_size)[source]
returned property prefector [4] in order: energy, force, virial, atom_ener
- class deepmd.utils.data.DeepmdData(sys_path: str, set_prefix: str = 'set', shuffle_test: bool = True, type_map: Optional[List[str]] = None, modifier=None, trn_all_set: bool = False)[source]
Bases:
object
Class for a data system.
It loads data from hard disk, and mantains the data as a data_dict
- Parameters
- sys_path
Path to the data system
- set_prefix
Prefix for the directories of different sets
- shuffle_test
If the test data are shuffled
- type_map
Gives the name of different atom types
- modifier
Data modifier that has the method modify_data
- trn_all_set
Use all sets as training dataset. Otherwise, if the number of sets is more than 1, the last set is left for test.
Methods
add
(key, ndof[, atomic, must, high_prec, ...])Add a data item that to be loaded
avg
(key)Return the average value of an item.
check_batch_size
(batch_size)Check if the system can get a batch of data with batch_size frames.
check_test_size
(test_size)Check if the system can get a test dataset with test_size frames.
Get atom types
get_batch
(batch_size)Get a batch of data with batch_size frames.
Get the data_dict
Get number of atoms
get_natoms_vec
(ntypes)Get number of atoms and number of atoms in different types
Number of atom types in the system
get_numb_batch
(batch_size, set_idx)Get the number of batches in a set.
Get number of training sets
get_sys_numb_batch
(batch_size)Get the number of batches in the data system.
get_test
([ntests])Get the test data with ntests frames.
Get the type map
reduce
(key_out, key_in)Generate a new item from the reduction of another atom
reset_get_batch
- add(key: str, ndof: int, atomic: bool = False, must: bool = False, high_prec: bool = False, type_sel: Optional[List[int]] = None, repeat: int = 1, default: float = 0.0)[source]
Add a data item that to be loaded
- Parameters
- key
The key of the item. The corresponding data is stored in sys_path/set.*/key.npy
- ndof
The number of dof
- atomic
The item is an atomic property. If False, the size of the data should be nframes x ndof If True, the size of data should be nframes x natoms x ndof
- must
The data file sys_path/set.*/key.npy must exist. If must is False and the data file does not exist, the data_dict[find_key] is set to 0.0
- high_prec
Load the data and store in float64, otherwise in float32
- type_sel
Select certain type of atoms
- repeat
The data will be repeated repeat times.
- default
float
, default=0. default value of data
- check_batch_size(batch_size)[source]
Check if the system can get a batch of data with batch_size frames.
- check_test_size(test_size)[source]
Check if the system can get a test dataset with test_size frames.
- get_batch(batch_size: int) dict [source]
Get a batch of data with batch_size frames. The frames are randomly picked from the data system.
- Parameters
- batch_size
size of the batch
- get_natoms_vec(ntypes: int)[source]
Get number of atoms and number of atoms in different types
- Parameters
- ntypes
Number of types (may be larger than the actual number of types in the system).
- Returns
natoms
natoms[0]: number of local atoms natoms[1]: total number of atoms held by this processor natoms[i]: 2 <= i < Ntypes+2, number of type i atoms
- get_test(ntests: int = - 1) dict [source]
Get the test data with ntests frames.
- Parameters
- ntests
Size of the test data set. If ntests is -1, all test data will be get.
deepmd.utils.data_system module
- class deepmd.utils.data_system.DataSystem(systems, set_prefix, batch_size, test_size, rcut, run_opt=None)[source]
Bases:
object
Outdated class for the data systems.
Deprecated since version 2.0.0: This class is not maintained any more.
Methods
check_type_map_consistency
compute_energy_shift
format_name_length
get_batch
get_batch_size
get_nbatches
get_nsystems
get_ntypes
get_sys
get_test
get_type_map
numb_fparam
print_summary
process_sys_weights
- class deepmd.utils.data_system.DeepmdDataSystem(systems: List[str], batch_size: int, test_size: int, rcut: float, set_prefix: str = 'set', shuffle_test: bool = True, type_map: Optional[List[str]] = None, modifier=None, trn_all_set=False, sys_probs=None, auto_prob_style='prob_sys_size')[source]
Bases:
object
Class for manipulating many data systems.
It is implemented with the help of DeepmdData
Methods
add
(key, ndof[, atomic, must, high_prec, ...])Add a data item that to be loaded
add_dict
(adict)Add items to the data system by a dict.
get_batch
([sys_idx])Get a batch of data from the data systems
Get the batch size
Get the total number of batches
Get the number of data systems
Get the number of types
get_sys
(idx)Get a certain data system
get_sys_ntest
([sys_idx])Get number of tests for the currently selected system,
get_test
([sys_idx, n_test])Get test data from the the data systems.
Get the type map
reduce
(key_out, key_in)Generate a new item from the reduction of another atom
compute_energy_shift
get_data_dict
print_summary
set_sys_probs
- add(key: str, ndof: int, atomic: bool = False, must: bool = False, high_prec: bool = False, type_sel: Optional[List[int]] = None, repeat: int = 1, default: float = 0.0)[source]
Add a data item that to be loaded
- Parameters
- key
The key of the item. The corresponding data is stored in sys_path/set.*/key.npy
- ndof
The number of dof
- atomic
The item is an atomic property. If False, the size of the data should be nframes x ndof If True, the size of data should be nframes x natoms x ndof
- must
The data file sys_path/set.*/key.npy must exist. If must is False and the data file does not exist, the data_dict[find_key] is set to 0.0
- high_prec
Load the data and store in float64, otherwise in float32
- type_sel
Select certain type of atoms
- repeat
The data will be repeated repeat times.
- default, default=0.
Default value of data
- add_dict(adict: dict) None [source]
Add items to the data system by a dict. adict should have items like .. code-block:: python
- adict[key] = {
‘ndof’: ndof, ‘atomic’: atomic, ‘must’: must, ‘high_prec’: high_prec, ‘type_sel’: type_sel, ‘repeat’: repeat,
}
For the explaination of the keys see add
- get_batch(sys_idx: Optional[int] = None)[source]
Get a batch of data from the data systems
- Parameters
- sys_idx: int
The index of system from which the batch is get. If sys_idx is not None, sys_probs and auto_prob_style are ignored If sys_idx is None, automatically determine the system according to sys_probs or auto_prob_style, see the following.
- get_sys(idx: int) deepmd.utils.data.DeepmdData [source]
Get a certain data system
- get_sys_ntest(sys_idx=None)[source]
- Get number of tests for the currently selected system,
or one defined by sys_idx.
- get_test(sys_idx: Optional[int] = None, n_test: int = - 1)[source]
Get test data from the the data systems.
- Parameters
- sys_idx
The test dat of system with index sys_idx will be returned. If is None, the currently selected system will be returned.
- n_test
Number of test data. If set to -1 all test data will be get.
deepmd.utils.errors module
deepmd.utils.graph module
- deepmd.utils.graph.get_embedding_net_nodes(model_file: str, suffix: str = '') Dict [source]
Get the embedding net nodes with the given frozen model(model_file)
- deepmd.utils.graph.get_embedding_net_nodes_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef, suffix: str = '') Dict [source]
Get the embedding net nodes with the given tf.GraphDef object
- deepmd.utils.graph.get_embedding_net_variables(model_file: str, suffix: str = '') Dict [source]
Get the embedding net variables with the given frozen model(model_file)
- deepmd.utils.graph.get_embedding_net_variables_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef, suffix: str = '') Dict [source]
Get the embedding net variables with the given tf.GraphDef object
- deepmd.utils.graph.get_fitting_net_nodes(model_file: str) Dict [source]
Get the fitting net nodes with the given frozen model(model_file)
- Parameters
- model_file
The input frozen model path
- Returns
Dict
The fitting net nodes with the given frozen model
- deepmd.utils.graph.get_fitting_net_nodes_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef) Dict [source]
Get the fitting net nodes with the given tf.GraphDef object
- Parameters
- graph_def
The input tf.GraphDef object
- Returns
Dict
The fitting net nodes within the given tf.GraphDef object
- deepmd.utils.graph.get_fitting_net_variables(model_file: str) Dict [source]
Get the fitting net variables with the given frozen model(model_file)
- Parameters
- model_file
The input frozen model path
- Returns
Dict
The fitting net variables within the given frozen model
- deepmd.utils.graph.get_fitting_net_variables_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef) Dict [source]
Get the fitting net variables with the given tf.GraphDef object
- Parameters
- graph_def
The input tf.GraphDef object
- Returns
Dict
The fitting net variables within the given tf.GraphDef object
- deepmd.utils.graph.get_pattern_nodes_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef, pattern: str) Dict [source]
Get the pattern nodes with the given tf.GraphDef object
- Parameters
- graph_def
The input tf.GraphDef object
- pattern
The node pattern within the graph_def
- Returns
Dict
The fitting net nodes within the given tf.GraphDef object
- deepmd.utils.graph.get_tensor_by_name(model_file: str, tensor_name: str) tensorflow.python.framework.ops.Tensor [source]
Load tensor value from the frozen model(model_file)
- deepmd.utils.graph.get_tensor_by_name_from_graph(graph: tensorflow.python.framework.ops.Graph, tensor_name: str) tensorflow.python.framework.ops.Tensor [source]
Load tensor value from the given tf.Graph object
- deepmd.utils.graph.get_tensor_by_type(node, data_type: numpy.dtype) tensorflow.python.framework.ops.Tensor [source]
Get the tensor value within the given node according to the input data_type
- Parameters
- node
The given tensorflow graph node
- data_type
The data type of the node
- Returns
tf.Tensor
The tensor value of the given node
- deepmd.utils.graph.get_type_embedding_net_nodes_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef, suffix: str = '') Dict [source]
Get the type embedding net nodes with the given tf.GraphDef object
- deepmd.utils.graph.get_type_embedding_net_variables_from_graph_def(graph_def: tensorflow.core.framework.graph_pb2.GraphDef, suffix: str = '') Dict [source]
Get the type embedding net variables with the given tf.GraphDef object
deepmd.utils.learning_rate module
- class deepmd.utils.learning_rate.LearningRateExp(start_lr: float, stop_lr: float = 5e-08, decay_steps: int = 5000, decay_rate: float = 0.95)[source]
Bases:
object
The exponentially decaying learning rate.
The learning rate at step \(t\) is given by
\[\alpha(t) = \alpha_0 \lambda ^ { t / \tau }\]where \(\alpha\) is the learning rate, \(\alpha_0\) is the starting learning rate, \(\lambda\) is the decay rate, and \(\tau\) is the decay steps.
- Parameters
- start_lr
Starting learning rate \(\alpha_0\)
- stop_lr
Stop learning rate \(\alpha_1\)
- decay_steps
Learning rate decay every this number of steps \(\tau\)
- decay_rate
The decay rate \(\lambda\). If stop_step is provided in build, then it will be determined automatically and overwritten.
Methods
build
(global_step[, stop_step])Build the learning rate
start_lr
()Get the start lr
value
(step)Get the lr at a certain step
- build(global_step: tensorflow.python.framework.ops.Tensor, stop_step: Optional[int] = None) tensorflow.python.framework.ops.Tensor [source]
Build the learning rate
- Parameters
- global_step
The tf Tensor prividing the global training step
- stop_step
The stop step. If provided, the decay_rate will be determined automatically and overwritten.
- Returns
learning_rate
The learning rate
deepmd.utils.neighbor_stat module
- class deepmd.utils.neighbor_stat.NeighborStat(ntypes: int, rcut: float)[source]
Bases:
object
Class for getting training data information.
It loads data from DeepmdData object, and measures the data info, including neareest nbor distance between atoms, max nbor size of atoms and the output data range of the environment matrix.
- Parameters
- ntypes
The num of atom types
- rcut
The cut-off radius
Methods
get_stat
(data)get the data statistics of the training data, including nearest nbor distance between atoms, max nbor size of atoms
- get_stat(data: deepmd.utils.data_system.DeepmdDataSystem) Tuple[float, List[int]] [source]
get the data statistics of the training data, including nearest nbor distance between atoms, max nbor size of atoms
- Parameters
- data
Class for manipulating many data systems. It is implemented with the help of DeepmdData.
- Returns
min_nbor_dist
The nearest distance between neighbor atoms
max_nbor_size
A list with ntypes integers, denotes the actual achieved max sel
deepmd.utils.network module
- deepmd.utils.network.embedding_net(xx, network_size, precision, activation_fn=<function tanh>, resnet_dt=False, name_suffix='', stddev=1.0, bavg=0.0, seed=None, trainable=True, uniform_seed=False, initial_variables=None, mixed_prec=None)[source]
The embedding network.
The embedding network function \(\mathcal{N}\) is constructed by is the composition of multiple layers \(\mathcal{L}^{(i)}\):
\[\mathcal{N} = \mathcal{L}^{(n)} \circ \mathcal{L}^{(n-1)} \circ \cdots \circ \mathcal{L}^{(1)}\]A layer \(\mathcal{L}\) is given by one of the following forms, depending on the number of nodes: [1]
\[\begin{split}\mathbf{y}=\mathcal{L}(\mathbf{x};\mathbf{w},\mathbf{b})= \begin{cases} \boldsymbol{\phi}(\mathbf{x}^T\mathbf{w}+\mathbf{b}) + \mathbf{x}, & N_2=N_1 \\ \boldsymbol{\phi}(\mathbf{x}^T\mathbf{w}+\mathbf{b}) + (\mathbf{x}, \mathbf{x}), & N_2 = 2N_1\\ \boldsymbol{\phi}(\mathbf{x}^T\mathbf{w}+\mathbf{b}), & \text{otherwise} \\ \end{cases}\end{split}\]where \(\mathbf{x} \in \mathbb{R}^{N_1}\) is the input vector and \(\mathbf{y} \in \mathbb{R}^{N_2}\) is the output vector. \(\mathbf{w} \in \mathbb{R}^{N_1 \times N_2}\) and \(\mathbf{b} \in \mathbb{R}^{N_2}\) are weights and biases, respectively, both of which are trainable if trainable is True. \(\boldsymbol{\phi}\) is the activation function.
- Parameters
- xx
Tensor
Input tensor \(\mathbf{x}\) of shape [-1,1]
- network_size: list of int
Size of the embedding network. For example [16,32,64]
- precision:
Precision of network weights. For example, tf.float64
- activation_fn:
Activation function \(\boldsymbol{\phi}\)
- resnet_dt: boolean
Using time-step in the ResNet construction
- name_suffix: str
The name suffix append to each variable.
- stddev: float
Standard deviation of initializing network parameters
- bavg: float
Mean of network intial bias
- seed: int
Random seed for initializing network parameters
- trainable: boolean
If the network is trainable
- uniform_seedbool
Only for the purpose of backward compatibility, retrieves the old behavior of using the random seed
- initial_variables
dict
The input dict which stores the embedding net variables
- mixed_prec
The input dict which stores the mixed precision setting for the embedding net
- xx
References
- 1
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Identitymappings in deep residual networks. InComputer Vision – ECCV 2016,pages 630–645. Springer International Publishing, 2016.
- deepmd.utils.network.one_layer(inputs, outputs_size, activation_fn=<function tanh>, precision=tf.float64, stddev=1.0, bavg=0.0, name='linear', reuse=None, seed=None, use_timestep=False, trainable=True, useBN=False, uniform_seed=False, initial_variables=None, mixed_prec=None, final_layer=False)[source]
- deepmd.utils.network.variable_summaries(var: tensorflow.python.ops.variables.VariableV1, name: str)[source]
Attach a lot of summaries to a Tensor (for TensorBoard visualization).
- Parameters
- var
tf.Variable
[description]
- name
str
variable name
- var
deepmd.utils.pair_tab module
- class deepmd.utils.pair_tab.PairTab(filename: str)[source]
Bases:
object
- Parameters
- filename
File name for the short-range tabulated potential. The table is a text data file with (N_t + 1) * N_t / 2 + 1 columes. The first colume is the distance between atoms. The second to the last columes are energies for pairs of certain types. For example we have two atom types, 0 and 1. The columes from 2nd to 4th are for 0-0, 0-1 and 1-1 correspondingly.
Methods
get
()Get the serialized table.
reinit
(filename)Initialize the tabulated interaction
- reinit(filename: str) None [source]
Initialize the tabulated interaction
- Parameters
- filename
File name for the short-range tabulated potential. The table is a text data file with (N_t + 1) * N_t / 2 + 1 columes. The first colume is the distance between atoms. The second to the last columes are energies for pairs of certain types. For example we have two atom types, 0 and 1. The columes from 2nd to 4th are for 0-0, 0-1 and 1-1 correspondingly.
deepmd.utils.parallel_op module
- class deepmd.utils.parallel_op.ParallelOp(builder: Callable[[...], Tuple[Dict[str, tensorflow.python.framework.ops.Tensor], Tuple[tensorflow.python.framework.ops.Tensor]]], nthreads: Optional[int] = None, config: Optional[tensorflow.core.protobuf.config_pb2.ConfigProto] = None)[source]
Bases:
object
Run an op with data parallelism.
- Parameters
Examples
>>> from deepmd.env import tf >>> from deepmd.utils.parallel_op import ParallelOp >>> def builder(): ... x = tf.placeholder(tf.int32, [1]) ... return {"x": x}, (x + 1) ... >>> p = ParallelOp(builder, nthreads=4) >>> def feed(): ... for ii in range(10): ... yield {"x": [ii]} ... >>> print(*p.generate(tf.Session(), feed())) [1] [2] [3] [4] [5] [6] [7] [8] [9] [10]
Methods
generate
(sess, feed)Returns a generator.
deepmd.utils.path module
- class deepmd.utils.path.DPH5Path(path: str)[source]
Bases:
deepmd.utils.path.DPPath
The path class to data system (DeepmdData) for HDF5 files.
- Parameters
- path
str
path
- path
Notes
- OS - HDF5 relationship:
directory - Group file - Dataset
Methods
glob
(pattern)Search path using the glob pattern.
is_dir
()Check if self is directory.
is_file
()Check if self is file.
Load NumPy array.
load_txt
([dtype])Load NumPy array from text.
rglob
(pattern)This is like calling
DPPath.glob()
with **/ added in front of the given relative pattern.- glob(pattern: str) List[deepmd.utils.path.DPPath] [source]
Search path using the glob pattern.
- load_numpy() numpy.ndarray [source]
Load NumPy array.
- Returns
np.ndarray
loaded NumPy array
- load_txt(dtype: Optional[numpy.dtype] = None, **kwargs) numpy.ndarray [source]
Load NumPy array from text.
- Returns
np.ndarray
loaded NumPy array
- rglob(pattern: str) List[deepmd.utils.path.DPPath] [source]
This is like calling
DPPath.glob()
with **/ added in front of the given relative pattern.
- class deepmd.utils.path.DPOSPath(path: str)[source]
Bases:
deepmd.utils.path.DPPath
The OS path class to data system (DeepmdData) for real directories.
- Parameters
- path
str
path
- path
Methods
glob
(pattern)Search path using the glob pattern.
is_dir
()Check if self is directory.
is_file
()Check if self is file.
Load NumPy array.
load_txt
(**kwargs)Load NumPy array from text.
rglob
(pattern)This is like calling
DPPath.glob()
with **/ added in front of the given relative pattern.- glob(pattern: str) List[deepmd.utils.path.DPPath] [source]
Search path using the glob pattern.
- load_numpy() numpy.ndarray [source]
Load NumPy array.
- Returns
np.ndarray
loaded NumPy array
- load_txt(**kwargs) numpy.ndarray [source]
Load NumPy array from text.
- Returns
np.ndarray
loaded NumPy array
- rglob(pattern: str) List[deepmd.utils.path.DPPath] [source]
This is like calling
DPPath.glob()
with **/ added in front of the given relative pattern.
- class deepmd.utils.path.DPPath(path: str)[source]
Bases:
abc.ABC
The path class to data system (DeepmdData).
- Parameters
- path
str
path
- path
Methods
glob
(pattern)Search path using the glob pattern.
is_dir
()Check if self is directory.
is_file
()Check if self is file.
Load NumPy array.
load_txt
(**kwargs)Load NumPy array from text.
rglob
(pattern)This is like calling
DPPath.glob()
with **/ added in front of the given relative pattern.- abstract glob(pattern: str) List[deepmd.utils.path.DPPath] [source]
Search path using the glob pattern.
- abstract load_numpy() numpy.ndarray [source]
Load NumPy array.
- Returns
np.ndarray
loaded NumPy array
- abstract load_txt(**kwargs) numpy.ndarray [source]
Load NumPy array from text.
- Returns
np.ndarray
loaded NumPy array
- abstract rglob(pattern: str) List[deepmd.utils.path.DPPath] [source]
This is like calling
DPPath.glob()
with **/ added in front of the given relative pattern.
deepmd.utils.plugin module
Base of plugin systems.
- class deepmd.utils.plugin.Plugin[source]
Bases:
object
A class to register and restore plugins.
Examples
>>> plugin = Plugin() >>> @plugin.register("xx") def xxx(): pass >>> print(plugin.plugins['xx'])
Methods
get_plugin
(key)Visit a plugin by key.
register
(key)Register a plugin.
- class deepmd.utils.plugin.PluginVariant(*args, **kwargs)[source]
Bases:
object
A class to remove type from input arguments.
- class deepmd.utils.plugin.VariantABCMeta(name, bases, namespace, **kwargs)[source]
Bases:
deepmd.utils.plugin.VariantMeta
,abc.ABCMeta
Methods
__call__
(*args, **kwargs)Remove type and keys that starts with underline.
mro
(/)Return a type's method resolution order.
register
(subclass)Register a virtual subclass of an ABC.
deepmd.utils.random module
- deepmd.utils.random.choice(a: numpy.ndarray, p: Optional[numpy.ndarray] = None)[source]
Generates a random sample from a given 1-D array.
- Parameters
- a
np.ndarray
A random sample is generated from its elements.
- p
np.ndarray
The probabilities associated with each entry in a.
- a
- Returns
np.ndarray
arrays with results and their shapes
- deepmd.utils.random.random(size=None)[source]
Return random floats in the half-open interval [0.0, 1.0).
- Parameters
- size
Output shape.
- Returns
np.ndarray
Arrays with results and their shapes.
- deepmd.utils.random.seed(val: Optional[int] = None)[source]
Seed the generator.
- Parameters
- val
int
Seed.
- val
- deepmd.utils.random.shuffle(x: numpy.ndarray)[source]
Modify a sequence in-place by shuffling its contents.
- Parameters
- x
np.ndarray
The array or list to be shuffled.
- x
deepmd.utils.sess module
deepmd.utils.tabulate module
- class deepmd.utils.tabulate.DPTabulate(descrpt: deepmd.descriptor.descriptor.Descriptor, neuron: typing.List[int], model_file: str, type_one_side: bool = False, exclude_types: typing.List[typing.List[int]] = [], activation_fn: typing.Callable[[tensorflow.python.framework.ops.Tensor], tensorflow.python.framework.ops.Tensor] = <function tanh>, suffix: str = '')[source]
Bases:
object
Class for tabulation.
Compress a model, which including tabulating the embedding-net. The table is composed of fifth-order polynomial coefficients and is assembled from two sub-tables. The first table takes the stride(parameter) as it’s uniform stride, while the second table takes 10 * stride as its uniform stride The range of the first table is automatically detected by deepmd-kit, while the second table ranges from the first table’s upper boundary(upper) to the extrapolate(parameter) * upper.
- Parameters
- descrpt
Descriptor of the original model
- neuron
Number of neurons in each hidden layers of the embedding net \(\mathcal{N}\)
- model_file
The frozen model
- type_one_side
Try to build N_types tables. Otherwise, building N_types^2 tables
- exclude_types
List
[List
[int
]] The excluded pairs of types which have no interaction with each other. For example, [[0, 1]] means no interaction between type 0 and type 1.
- activation_function
The activation function in the embedding net. Supported options are {“tanh”,”gelu”} in common.ACTIVATION_FN_DICT.
- suffix
str
,optional
The suffix of the scope
Methods
build
(min_nbor_dist, extrapolate, stride0, ...)Build the tables for model compression
- build(min_nbor_dist: float, extrapolate: float, stride0: float, stride1: float) Tuple[Dict[str, int], Dict[str, int]] [source]
Build the tables for model compression
- Parameters
- min_nbor_dist
The nearest distance between neighbor atoms
- extrapolate
The scale of model extrapolation
- stride0
The uniform stride of the first table
- stride1
The uniform stride of the second table
- neuron
Number of neurons in each hidden layers of the embedding net \(\mathcal{N}\)
- Returns
deepmd.utils.type_embed module
- class deepmd.utils.type_embed.TypeEmbedNet(neuron: List[int] = [], resnet_dt: bool = False, activation_function: str = 'tanh', precision: str = 'default', trainable: bool = True, seed: Optional[int] = None, uniform_seed: bool = False)[source]
Bases:
object
- Parameters
- neuron
list
[int
] Number of neurons in each hidden layers of the embedding net
- resnet_dt
Time-step dt in the resnet construction: y = x + dt * phi (Wx + b)
- activation_function
The activation function in the embedding net. Supported options are “relu”, “relu6”, “softplus”, “sigmoid”, “tanh”, “gelu”.
- precision
The precision of the embedding net parameters. Supported options are “default”, “float16”, “float32”, “float64”.
- trainable
If the weights of embedding net are trainable.
- seed
Random seed for initializing the network parameters.
- uniform_seed
Only for the purpose of backward compatibility, retrieves the old behavior of using the random seed
- neuron
Methods
build
(ntypes[, reuse, suffix])Build the computational graph for the descriptor
init_variables
(graph, graph_def[, suffix])Init the type embedding net variables with the given dict
- build(ntypes: int, reuse=None, suffix='')[source]
Build the computational graph for the descriptor
- Parameters
- ntypes
Number of atom types.
- reuse
The weights in the networks should be reused when get the variable.
- suffix
Name suffix to identify this descriptor
- Returns
embedded_types
The computational graph for embedded types
- init_variables(graph: tensorflow.python.framework.ops.Graph, graph_def: tensorflow.core.framework.graph_pb2.GraphDef, suffix='') None [source]
Init the type embedding net variables with the given dict
- Parameters
- graph
tf.Graph
The input frozen model graph
- graph_def
tf.GraphDef
The input frozen model graph_def
- suffix
Name suffix to identify this descriptor
- graph
- deepmd.utils.type_embed.embed_atom_type(ntypes: int, natoms: tensorflow.python.framework.ops.Tensor, type_embedding: tensorflow.python.framework.ops.Tensor)[source]
Make the embedded type for the atoms in system. The atoms are assumed to be sorted according to the type, thus their types are described by a tf.Tensor natoms, see explanation below.
- Parameters
- ntypes:
Number of types.
- natoms:
The number of atoms. This tensor has the length of Ntypes + 2 natoms[0]: number of local atoms natoms[1]: total number of atoms held by this processor natoms[i]: 2 <= i < Ntypes+2, number of type i atoms
- type_embedding:
The type embedding. It has the shape of [ntypes, embedding_dim]
- Returns
atom_embedding
The embedded type of each atom. It has the shape of [numb_atoms, embedding_dim]