Posts by Category

CUDA

Camera

[Research] Visually understanding DoF with the thins lens model

6 minute read

Please contact me if there is any inaccurate content in this article. I believe the thin lens model is the most straightforward way to understand how the depth of field (DoF) is formed within a camera. We may simplify a complex lens model using the thin lens model for DoF to ...

NIS

How to set up NIS for Ubuntu

4 minute read

NIS is very useful tool to automatically set up user information between clusters. Currently, our lab maintains 9 clusters: mark0-8. Here, mark1 is working as the NIS server where others are clients.

PyTorch

How to use LMDB with PyTorch DataLoader and DistributedDataParallel

1 minute read

Since LMDB cannot be pickled, an error, ...can't pickle Environment Object..., occurs when we naively implement LMDB into data.dataset while wrapping data.DataLoader with Distributed Data Parallel(DDP). To resolve the error, we need to delay the loading of LMDB environment in ...

Research

How to use LMDB with PyTorch DataLoader and DistributedDataParallel

1 minute read

Since LMDB cannot be pickled, an error, ...can't pickle Environment Object..., occurs when we naively implement LMDB into data.dataset while wrapping data.DataLoader with Distributed Data Parallel(DDP). To resolve the error, we need to delay the loading of LMDB environment in ...

[Research] Visually understanding DoF with the thins lens model

6 minute read

Please contact me if there is any inaccurate content in this article. I believe the thin lens model is the most straightforward way to understand how the depth of field (DoF) is formed within a camera. We may simplify a complex lens model using the thin lens model for DoF to ...

Sublime Text 3

Windows10

deep learning

How to set up logging level in Tensorlayer and Tensorflow

less than 1 minute read

In python logger, there are 5 logging levels: {50: 'FATAL', 40: 'ERROR', 30: 'WARN', 20: 'INFO', 10: 'DEBUG'}. The logger only prints logs that are higher than the default logging level. By default, the logging level in both tensorlayer and tensorflow is WARN. This posts chang...

docker

How to install nvcc for conda-installed PyTorch in Ubuntu

less than 1 minute read

When we install PyTorch using conda (e.g.,conda install pytorch torchvision torchaudio cudatoolkit=10.2 -c pytorch), it incompletly installs the cudatoolkit, which means that we cannot use nvcc provided by the cudatoolkit.

How to push to or pull from docker hub

less than 1 minute read

Docker hub is very useful for maintaining images, especially when you are working with many machines with the same image. My DockerHub

git

installation

Dotdrop workflow

1 minute read

I use dotdrop for managing my dotfiles (.zshrc, .vimrc, .tmux.conf, etc.)

lab

GPU status checking in Ubuntu

less than 1 minute read

Currently, we are maintaining four clusters: mark0, mark1, mark2, mark3. For checking GPU status, mark0 works as a server where each client (clusters including mark0) runs a shell script informing GPU usages.

User management in Ubuntu

1 minute read

This post describes a multi user management method that I use in the lab. Since all the users require a root privilege, it is better to have only one group with the root privilege. Add group $ sudo groupadd --gid 2000 cglab Add user $ sudo useradd [username] -m $ sudo passwd ...

nvidia

nvidia-docker

python

How to solve ImportError: cannot import name 'main'

less than 1 minute read

When I upgrade pip3 by typing sudo pip3 install -U pip and use the upgraded one, I get the error message ‘ImportError: cannot import name 'main'’. This is because a collision between pip3s installed by ubuntu and python3.

samba

How to configure Samba on Ubuntu

1 minute read

This article introduces how to install and configure Samba on Ubuntu16.04. Also, we introduce how to mount the shared folder on Ubuntu and Windows. 1. Install and configure Samba Installation Samba only needs to be installed for the server: $ sudo apt-get install samba samba-c...

tensorflow

How to set up logging level in Tensorlayer and Tensorflow

less than 1 minute read

In python logger, there are 5 logging levels: {50: 'FATAL', 40: 'ERROR', 30: 'WARN', 20: 'INFO', 10: 'DEBUG'}. The logger only prints logs that are higher than the default logging level. By default, the logging level in both tensorlayer and tensorflow is WARN. This posts chang...

tmux

ubuntu

How to install nvcc for conda-installed PyTorch in Ubuntu

less than 1 minute read

When we install PyTorch using conda (e.g.,conda install pytorch torchvision torchaudio cudatoolkit=10.2 -c pytorch), it incompletly installs the cudatoolkit, which means that we cannot use nvcc provided by the cudatoolkit.

Dotdrop workflow

1 minute read

I use dotdrop for managing my dotfiles (.zshrc, .vimrc, .tmux.conf, etc.)

How to solve ImportError: cannot import name 'main'

less than 1 minute read

When I upgrade pip3 by typing sudo pip3 install -U pip and use the upgraded one, I get the error message ‘ImportError: cannot import name 'main'’. This is because a collision between pip3s installed by ubuntu and python3.

How to set up NIS for Ubuntu

4 minute read

NIS is very useful tool to automatically set up user information between clusters. Currently, our lab maintains 9 clusters: mark0-8. Here, mark1 is working as the NIS server where others are clients.

How to fix ubuntu showing grub rescue at booting

1 minute read

When I reinstalled ubuntu from scratch, the machine sometimes throws following error. error: no such partition. Entering rescue mode... grub rescue> It seems that the system enters into grub rescue mode when grub is installed in a drive other than /dev/sda

How to push to or pull from docker hub

less than 1 minute read

Docker hub is very useful for maintaining images, especially when you are working with many machines with the same image. My DockerHub

How to run app with the root privilege without a password in Ubuntu

less than 1 minute read

Sometimes, there is a need of launching an app with a root privilege. For example, Vmware requires the root privilege when it needs to use physical hard drive. Also, Sublime, for example, it needs to be opened with the root privilege when we need to modify a file written as a ...

Setting up LVM(Logical Volume Management) in Ubuntu

1 minute read

In this article, we are grouping four SSDs into two logical drives where each group consists of two SSDs. 1. Install LVM $ sudo apt-get update $ sudo apt-get install lvm2 2. Configure LVM $ sudo su` $ pvcreate /dev/sdb1 /dev/sdc1 /dev/sdd1 /dev/sde1 $ vgcreate vg001 /dev/sdb1...

How to configure Samba on Ubuntu

1 minute read

This article introduces how to install and configure Samba on Ubuntu16.04. Also, we introduce how to mount the shared folder on Ubuntu and Windows. 1. Install and configure Samba Installation Samba only needs to be installed for the server: $ sudo apt-get install samba samba-c...

User management in Ubuntu

1 minute read

This post describes a multi user management method that I use in the lab. Since all the users require a root privilege, it is better to have only one group with the root privilege. Add group $ sudo groupadd --gid 2000 cglab Add user $ sudo useradd [username] -m $ sudo passwd ...

vim

zsh