I am wondering is there an introductory algorithm textbook based on the feature of Wolfram Language, like Data Structures and Algorithms in Python?
Not an algorithm textbook per se but you could take a look at Wellin's Programming with Mathematica (TOC and sample chapters) to see if it suits your needs. Some more options here: https://shift-enter.org/learning-resources/