跳转至

郭睿明的小屋

关于 MLP 和 Transformer 的小小调研

正在初始化搜索引擎

dandelight/dandelight.github.io

欢迎回家
About ME
欢迎回家
博客写作原则
Blog
Course
Engineering
Life
Research
Tool
WeBook
Meta

郭睿明的小屋

dandelight/dandelight.github.io

欢迎回家
About ME
欢迎回家
博客写作原则
Blog
Blog
Course
Course
- Aliyun
  Aliyun
- Code Complete
  Code Complete
- Compiler Principles
  Compiler Principles
  - 语法分析 Parse
- Computer Networking
  Computer Networking
  - 计算机网络中的流量控制与拥塞控制
  - Network layer
  - Server
  - Ch1
    Ch1
    
    Introduction
  - Ch2
    Ch2
    
    Mailing protocols: STMP, POP3, and IMAP
- Database
  Database
- Deep Learning
  Deep Learning
  - PointNet
  - ViT&MLP
  - Metrics
  - Smooth l1 loss
  - LSTM
    
    LSTM
  - Tools
    Tools
    
    Docker
    
    MindSpore
    MindSpore
    
    从源码开始编译MindSpore
    
    自定义数据集
  - Cs231n
    Cs231n
    
    CS231n Convolutional Neural Network for Visual Recognition
    
    02
    
    优化方法：随机梯度下降
    
    ConvNets!
    
    05
- Design Patterns
  Design Patterns
- Embedded Systems
  Embedded Systems
  - ARM
    ARM
    
    Running arm on x86
- Huawei Fullstack AI
  Huawei Fullstack AI
  - Ascend
    Ascend
    
    AscendCL 编程简明广播体操
    
    Basic developing
    
    语言基础
    
    Maker 五月昇腾技术讲座
    
    References&thanks
- IT Practice
  IT Practice
  - IT 企业实训体会
- Mathematics
  Mathematics
  - Lorenz
  - Trigonometric
  - Linear Algebra
    
    Linear Algebra
    
    LU 分解
- Multimodal
  Multimodal
  - 01 introduction
  - Optimization
- Network Engineering
  Network Engineering
  - PacketTracer
  - Packets
- Number Theory
  Number Theory
  - 原根
- Programming Language
  Programming Language
  - CPP
    CPP
    
    Clang-Format
  - CUDA
    
    CUDA
  - JavaScript
    JavaScript
    
    绕过网站复制控制的一些方法
    
    Mocha
    
    Tfjs
    Tfjs
    
    Chatbot
    Chatbot
    
    AI Chatbots With TensorFlow.js: Detecting Emotion in Text
    
    AI Chatbots With TensorFlow.js: Training a Trivia Expert AI
    
    AI Chatbots With TensorFlow.js: Improved Emotion Detection in Text
    
    AI Chatbots With TensorFlow.js: Improved Trivia Expert
    
    AI Chatbots With TensorFlow.js: Creating a Movie Dialogue Chatbot
    
    AI Chatbots With TensorFlow.js: Generating Shakespeare Monologue
    
    Vuejs
    Vuejs
    
    使用 Vue.js 开发 APP
    
    Toolbox
  - LaTeX
    LaTeX
    
    Greek Letters
    
    Installing the TeX Live (on Linux)
    
    多种数学环境公式的对比
    
    Orcid
    
    配置 LaTeX-Workshop
    
    Overleaf
    Overleaf
    
    Overleaf 私有化部署
  - MATLAB
    MATLAB
    
    MATLAB 模块化编程
  - Powershell
    Powershell
    
    Bash 与 PowerShell 命令对照表
  - Python
    Python
    
    What exactly is a class?
    
    Python 面向对象
    
    Python import
    
    STRFTIME
    
    Hydra：Python 配置管理
    
    Conda
    Conda
    
    关于卸载了 MiniConda 之后 cmd [process exited with code 1 (0x00000001)] 这件小事
    
    conda与pip常用命令
    
    Env
    
    Numpy
    Numpy
    
    NumPy 中的 Axis 与广播机制
    
    numpy.linalg.eigh
    
    Einsum
    
    Torch
    Torch
    
    REIGNITE：重学 PyTorch
    
    Tensor 的基本操作
    
    Autograd 以及反向传播
    
    Regression: Torch as a Tensor library
    
    05 logistic regression
    
    Module 和 Optimizer
    
    Dataset 和 DataLoader
    
    起底 MLP
    
    09 CNN
    
    10 LSTM
    
    TensorBoard
    
    Profiler
    
    TorchScript
    
    CUSTOM C++ AND CUDA EXTENSIONS
    
    Clean Code
    
    Misc
    
    torch 中保证随机性的最佳实践
    
    Python & PyTorch 暗坑集合
- Project Managerment Professional
  Project Managerment Professional
- Scientific Writing
  Scientific Writing
  - Blog in blog
- Software Engineering
  Software Engineering
- Statistics
  Statistics
  - Mixture Models & Expectation Maximization
  - Time series
- Win32 Developing
  Win32 Developing
  - First things first
  - Reference
Engineering
Engineering
- ARGSS
  ARGSS
  - Conclusion
    Conclusion
    
    fromSLAM
  - Control
    Control
    
    Esp32 ledc
    
    Iocomp
    
    Modbus
    
    Ros tf
    
    Transform
  - Datasets
    
    Datasets
    
    Cornell Grasp Dataset
  - Design
    Design
    
    Circuit
    
    The Mechanical design of ARGSS
    
    Software
  - Experiments
    Experiments
    
    Replicate
  - Mechanical
    Mechanical
    
    File convert
    
    Sorting hand
  - PointCloudData
    PointCloudData
    
    开源点云标注工具调研与对比
  - RealSenseCamera
    RealSenseCamera
    
    About
    
    基于Qt 的 RealSense 相机数据采集软件
    
    获取 RealSense 相机内参
  - Robotics
    
    Robotics
  - Simulation
    Simulation
    
    CoppeliaSim
    
    Simscape
    
    Simscape
    
    Simscape
  - Vision
    Vision
    
    6DoFGraspNet
    
    AlexNet
    
    GR-ConvNet论文研读
    
    KeyPose
    
    Molecular Depth
    
    RGBD ROS
    
    Axis trans
    
    Dex net
    
    Gaussian based
    
    标定框和抓取位点的正解反解
    
    Grasp Detection
    
    Jacquard dataset
    
    TODO：整理仓库
    
    Rgbd registration
    
    Transformation
  - Graspnet
    
    Graspnet
- Competitive Programming
  Competitive Programming
- Computer Aided Drug Design
  Computer Aided Drug Design
- Data Science
  Data Science
  - E house price prediction full
- FunCloud
  FunCloud
- LISTEN
  LISTEN
  - Developing Android Accessibility Service
  - Oscar&VinVL
  - AI Mobilized
    AI Mobilized
    
    PyTorch on Android
  - Image Captioning
    Image Captioning
    
    AoAnet
- VectorDatabase
  VectorDatabase
  - faiss
- XiaoXiaoDou
  XiaoXiaoDou
  - How to Train Your Chatbot
  - IntelliJ Keymap
  - WeLM
  - Auth
  - 使用 certbot 获取证书并部署到阿里云 SAE next
  - kotlin 的语法糖(操作符)🍬
  - MongoDB Role-based Access Control
  - Mongodb springboot aggregate
  - uni-app
  - Flutter
    Flutter
    
    LinearGradient
    
    WebSocket 心跳、重连
    
    BLoC 模式
    
    Dart
  - SpringBoot
    SpringBoot
    
    Dubbo
Life
Life
- camelCase
- Data
- 活在互联网上
- 1Step1Scene
  1Step1Scene
- Relics
  Relics
  - 雪泥
Research
Research
- 训练样本中的偏见问题
- ReID 的评估指标
- Figures
- 如何阅读一篇（计算机科学）学术论文
- 使用 Git 进行科研实验版本控制
- Thoughts on Contrastive Learning
- CrossEntropyLoss
- Variational Autoencoder
- Wandb
- MultiModal
  MultiModal
- ViT
  ViT
  - Paper Digesting
    Paper Digesting
    
    关于 MLP 和 Transformer 的小小调研
    
    ELSA
    
    MAE ref
    
    Masked Autoencoders are Scalable Vision Learners
    
    MetaFormer
    
    Res2Net
    
    SCDA
    
    Swin-Transformer
    
    A Hitchhiker’s Guide On Distributed Training Of Deep Neural Networks
    
    Knee-Based Decision Making and Visualization in Many-Objective Optimization
    
    Segmentation
    Segmentation
    
    UNet 3+
Tool
Tool
- Amazon S3
- cURL 命令行并行下载
- Docker Compose
- The missing .dropboxignore
- FRP
- Fstab
- Fuser
- Gpg
- \(\mathrm{\LaTeX}\) 模板，latexmk 及 VS Code 配置
- Minio
- 镜像站快速使用手册
- Music, the markdown way
- Pandoc
- macOS 上创建自签名根证书
- Ssh forward
- Windows 自带 OpenSSH 服务器的安装与使用
- 在 Markdown 中合并单元格
- TMUX 快捷键对照
- PyTorch kl_div 的第一个参数居然需要是对数？
- Typora 替代品
- Usb
- Vim ref
- Wsl 1 and 2
- 异地虚拟局域网ZeroTier
- Docker
  Docker
- Git
  Git
- Macos
  Macos
- Open3d
  Open3d
- Powershell
  Powershell
  - 在 PowerShell 中设置系统环境变量
- Pyspark
  Pyspark
  - 认识 PySpark
  - 技术积累总结
- Scipy
  Scipy
  - Sparse
- Sphinx
  Sphinx
- Termux
  Termux
  - Remapping a Bluetooth keyboard on Android
WeBook
WeBook
- Clustering
- Derivation of KL Divergence
- Sparse Subspace Clustering and Low Rank Representation
- Sparse Coding and Dictionary Learning
- AcademicWriting
  AcademicWriting
  - Writing in Mathematics
- DimensionReduction
  DimensionReduction
- LinearAlgebra
  LinearAlgebra
  - 特征值分解与奇异值分解
  - Eig in scipy
- Matrix
  Matrix
- NerualNetwork
  NerualNetwork
  - Restricted Boltzmann Machine
- NoisyLabel
  NoisyLabel
- Probability
  Probability
  - 贝叶斯理论
  - 线性回归
- QA
  QA
  - Trace det
- RepresentationLearning
  RepresentationLearning
  - K SVD for Dictionary Learning
  - 正交匹配追赶法
- SciPy
  SciPy
  - Eig and eigh
- Space
  Space
  - Equivalence of Norm
- Statistics
  Statistics
  - Second order correlation
Meta
Meta

关于 MLP 和 Transformer 的小小调研¶

2024-07-31

Copyleft. All wrongs reversed.

Made with Material for MkDocs