Open Source LLM Assistant with Huawei Cloud ECS + GPU T4 (Part 1)

Leveraging on a few Open Source tools like ollama, I manage to deploy a Huawei Cloud base LLM Assistant with open source LLM.

The below is the user interface base on the llama3 LLM with customized Huawei logo. The LLM is deployed with Huawei Cloud ECS server with T4 GPU, and use the MobaSSH Tunnel tool to forward the user interface to local browser port 8080

Created 3 Model files to prompt engineer the LLM for specific purpose:

1. Multi Languages – Travel Planning
2. Use Refined llama2-chinese:7b to test the Chinese Travel Planning as llama3 is relatively weak in Chinese language generative capability
3. Huawei Cloud Big Data & AI Product Information Assistant ( Development In Progress => To add User Roles, Model Access Control, Virtual Host for sharing the LLM Assistant service within Huawei office LAN, RAG knowledge base from crawl internal marketing portal, as well as exported 2 years messages from internal instant messaging big data & AI product support group)

Below is the testing output of each the scenario above:

1. Test Travel planner Model
   1. 1. English

>>> help me to plan a trip to USA New York and nearby areas for 12 days
I’d be happy to help you plan your trip to New York and the surrounding areas!

Day 1: Arrival in New York City

* Arrive at John F. Kennedy International Airport (JFK) or LaGuardia Airport (LGA)
* Take a taxi or ride-share service to your hotel
* Check-in at a hotel in Midtown Manhattan, such as the Pod Hotel Brooklyn or the YOTEL New York Times Square
* Spend the afternoon exploring Times Square, Central Park, and the nearby Museum of Modern Art (MoMA)

Day 2: New York City

* Start the day with breakfast at a classic NYC diner, like Sarabeth’s or Russ & Daughters Cafe
* Take a stroll across the Brooklyn Bridge for spectacular city views
* Visit the iconic Statue of Liberty and Ellis Island
* End the day with a Broadway show or a jazz performance in Greenwich Village

Day 3: New York City

* Spend the morning exploring the High Line, an elevated park built on old rail tracks
* Visit the American Museum of Natural History or the Metropolitan Museum of Art (The Met)
* Enjoy dinner at one of the many excellent Italian restaurants in Little Italy

Day 4: Upstate New York

* Take a day trip to the Catskill Mountains, about a 2-hour drive from NYC
* Hike to the top of Kaaterskill Falls or explore the charming town of Woodstock
* Return to NYC in the evening and enjoy dinner at a classic American diner

Day 5: Boston, Massachusetts

* Take an Amtrak train to Boston ( approx. 4 hours)
* Check-in at a hotel in the Back Bay neighborhood, such as the Hotel Commonwealth or the Verb Hotel
* Visit the Freedom Trail, which takes you through historic sites like Faneuil Hall and the Old State House

Day 6: Boston

* Explore the Boston Common and Public Garden, home to the famous Swan Boats
* Visit the Museum of Fine Arts (MFA) or the Institute of Contemporary Art (ICA)
* Enjoy dinner at a classic Boston seafood restaurant

Day 7: Cape Cod, Massachusetts

* Take a day trip to Cape Cod ( approx. 3 hours by car)
* Visit the picturesque town of Provincetown and explore the Cape Cod National Seashore
* Return to Boston in the evening and enjoy dinner at a local favorite spot

Day 8: New York City

* Return to NYC and spend the day exploring the trendy neighborhood of Williamsburg, Brooklyn
* Visit the Brooklyn Brewery or take a stroll along the East River waterfront
* Enjoy dinner at one of the many excellent restaurants in the Lower East Side

Day 9: Philadelphia, Pennsylvania

* Take an Amtrak train to Philadelphia ( approx. 2 hours)
* Check-in at a hotel near Independence Hall, such as the Hotel Monaco or the Kimpton Hotel Monaco
* Visit Independence Hall and explore the Liberty Bell Center
* Enjoy dinner at a classic Philly cheesesteak joint

Day 10: Philadelphia

* Spend the day exploring the iconic steps of the Philadelphia Museum of Art (run up them like Rocky!)
* Visit the Eastern State Penitentiary or take a stroll through Fairmount Park
* Enjoy dinner at one of the many excellent restaurants in Fishtown

Day 11: New York City

* Return to NYC and spend the day exploring the Upper East Side, including Central Park and the Met
* Visit the iconic Plaza Hotel or take a stroll along Fifth Avenue
* Enjoy dinner at one of the many excellent restaurants in Midtown West

Day 12: Departure from New York City

* Spend the morning shopping for last-minute souvenirs or visiting any last-minute attractions
* Take a taxi or ride-share service to JFK or LGA airport for your departure flight

Budget Breakdown:

* Transportation (trains, taxis, etc.): $200-$300
* Accommodations (hotels and lodges): $1,500-$2,000
* Food and drink: $800-$1,200
* Activities and attractions: $400-$600
* Total: $3,100-$4,600

Hotel Recommendations:

* Pod Hotel Brooklyn: $150-$250 per night
* YOTEL New York Times Square: $180-$300 per night
* Hotel Commonwealth (Boston): $150-$280 per night
* Verb Hotel (Boston): $120-$220 per night
* Hotel Monaco (Philadelphia): $140-$260 per night

Please note that prices are estimates and may vary depending on the time of year, availability, and other factors. I hope this helps you plan your trip to New York and the surrounding areas!

ii. Mandarin (Simplified Chinese) – answer not optimized in llama3, initially it answer in English instead of Mandarin
>> 帮我计划一下北京和西安12天的行程，用简体中文回答我
**北京和西安12天行程**
**第一天：到达北京**
* 到达北京首都国际机场
* 在酒店入住并休息一下
* 到 Wangfujing街看看北京夜市的文化气息
**第二天至第三天：北京**
* 探索 forbidden city，明清两代皇宫
* 走近 Mutianyu长城，一段最为保存完好的长城
* 访问 Temple of Heaven，联合国教育科学组织世界遗产和former royal altar
**第四天：从北京到西安**
* 晚上坐火车或飞机从北京到西安（大约10小时）
* 在西安入住酒店
**第五天至第六天：西安**
* 探索西安古城墙和看台
* 访问 Terracotta Warriors，联合国教育科学组织世界遗产和中国最为著名的旅游景点之一
* 走近穆斯林区和尝试一些当地street food
**第七天：西安**
* 访问 Big Wild Goose Pagoda，西安著名的地标
* 探索 Shaanxi History Museum，了解西安的历史和文化
**第八天至第九天：西安**
* 一天游Pingyao古城（大约2.5小时）
* 访问 Ming Qin Mausoleum，联合国教育科学组织世界遗产和former royal tomb
* 走近穆斯林区和尝试一些当地street food
**第十天至第十一天：北京**
* 返回北京坐火车或飞机（大约10小时）
* 访问 Summer Palace，联合国教育科学组织世界遗产和former royal palace
* 走近 Hutong Courtyard，一座传统的中国庭院
**第十二天：离开北京**
* 出酒店和离开北京首都国际机场

iii. Bahasa Malaysia
>>> Bantu saya merancang perjalanan 12 hari ke Malaysia, gunakan bahasa malaysia untuk menjawab saya
Saya senang membantu merancang perjalanan 12 hari ke Malaysia!

**Tarikh Terbaik:** Sepanjang tahun, tetapi musim panas (Jun hingga September) dan musim sejuk (November hingga Mac) adalah masa terbaik untuk mengunjungi Malaysia. Suhu udara yang hangat dan
cuaca yang cerah membuat perjalanan Anda lebih menyenangkan.

**Rancangan Perjalanan:** Berikut rancangan perjalanan 12 hari ke Malaysia:

Hari 1: Tiba di Kuala Lumpur, Malaysia
* Tiba di Lapangan Terbang Antarabangsa Kuala Lumpur (KLIA) dan menginap di hotel di pusat bandar.
* Lawati mercu Buaya dan Pasar Seni di Jalan Petaling.

Hari 2-3: Kuala Lumpur
* Lawati Menara KL Tower, Tugu Negara dan Masjid Jamek.
* Perjalanan ke Taman Negara untuk melihat haiwan liar dan tumbuhan yang unik.

Hari 4-5: Penang
* Berpindahkan ke Pulau Pinang dengan kereta api atau bas.
* Lawati George Town, sebuah bandar bersejarah yang diwartakan UNESCO.
* Makanan laut yang enak di salah satu restoran seafood di sekitar.

Hari 6-7: Langkawi
* Berpindahkan ke Pulau Langkawi dengan kereta api atau bas.
* Lawati Taman Negara Langkawi dan melihat haiwan liar seperti monyet dan reptil.
* Menyaksikan pemandangan sunset di Pantai Cenang.

Hari 8-9: Cameron Highlands
* Berpindahkan ke Tanah Tinggi Cameron dengan kereta api atau bas.
* Lawati Taman Negara Cameron Highlands dan melihat tumbuhan yang unik.
* Mengeksplor lokasi-lokasi lain seperti Loam Weir dan Mossy Forest.

Hari 10-11: Kuala Lumpur
* Berpindahkan kembali ke Kuala Lumpur dengan kereta api atau bas.
* Lawati Mercu Buaya dan Pasar Seni di Jalan Petaling untuk membeli cenderahati.
* Mengeksplor lokasi-lokasi lain seperti Bangunan Sultan Abdul Samad dan Tugu Negara.

Hari 12: Pergi pulang
* Menginap di hotel sebelum pergi pulang ke Lapangan Terbang Antarabangsa Kuala Lumpur (KLIA).

**Kos Perjalanan:** Berikut kos perjalanan yang diestimasi:

* Transportasi: RM1,000-RM2,000 (sekitar USD 250-500)
* Penginapan: RM3,000-RM5,000 (sekitar USD 750-1,250) untuk seorang
* Makanan: RM500-RM1,000 (sekitar USD 125-250) per hari, total RM6,000-RM12,000 (sekitar USD 1,500-3,000)
* Aktiviti: RM200-RM500 (sekitar USD 50-125) per orang, total RM2,400-RM6,000 (sekitar USD 600-1,500)

Jumlah kos yang diestimasi adalah RM10,800-RM22,000 (sekitar USD 2,700-5,500). Sila memantau kos-kos lain seperti tiket masuk ke lokasi-lokasi dan lain-lain.

Saya harap dapat membantu Anda merancang perjalanan yang lebih menyenangkan di Malaysia!

iv. Bahasa Indonesia
>>> Bantu saya merencanakan perjalanan 12 hari ke Indonesia, gunakan bahasa indonesia untuk menjawab saya
Saya senang membantu Anda merancang perjalanan 12 hari ke Indonesia!
**Rencana Perjalanan:** Berikut rencana perjalanan 12 hari ke Indonesia:
Hari 1: Tiba di Jakarta
* Tiba di Bandar Udara Internasional Soekarno-Hatta dan menginap di hotel di pusat kota.
* Lawati Monumen Nasional (Monas) dan Istana Negara untuk melihat sejarah Indonesia.
Hari 2-3: Jakarta
* Lawati Kota Tua, sebuah kompleks bersejarah yang terdiri dari bangunan-bangunan lama.
* Perjalanan ke Pulau Tidori untuk menikmati pemandangan sunset dan malam di kota.
* Makanan makan siang di salah satu restoran tradisional di Jakarta.
Hari 4-5: Yogyakarta
* Berpindahkan ke Yogyakarta dengan kereta api atau pesawat udara.
* Lawati Candi Borobudur, sebuah candi Buddha terbesar di dunia.
* Perjalanan ke Candi Prambanan untuk melihat kompleks candi Hindu.
Hari 6-7: Bali
* Berpindahkan ke Bali dengan pesawat udara.
* Lawati Pantai Kuta dan menginap di hotel di daerah tersebut.
* Menyaksikan pemandangan sunrise di Gunung Batur.
* Makanan makan siang di salah satu restoran seafood di Jimbaran.
Hari 8-9: Lombok
* Berpindahkan ke Lombok dengan feri atau pesawat udara.
* Lawati Pantai Pink dan menginap di hotel di daerah tersebut.
* Perjalanan ke Gunung Rinjani untuk melihat pemandangan sunrise.
* Makanan makan siang di salah satu restoran tradisional di Lombok.
Hari 10-11: Jakarta
* Berpindahkan kembali ke Jakarta dengan pesawat udara atau kereta api.
* Lawati Museum Nasional Indonesia untuk mempelajari sejarah Indonesia.
* Perjalanan ke Taman Mini Indonesia Indah untuk melihat miniatur kota-kota di Indonesia.
Hari 12: Pergi pulang
* Menginap di hotel sebelum pergi pulang ke Bandar Udara Internasional Soekarno-Hatta.
**Kos Perjalanan:** Berikut kos perjalanan yang diestimasi:
* Transportasi: Rp10.000.000- Rp20.000.000 (sekitar USD 700-1,400)
* Penginapan: Rp5.000.000- Rp10.000.000 (sekitar USD 350-700) untuk seorang
* Makanan: Rp500.000- Rp1.000.000 (sekitar USD 35-70) per hari, total Rp6.000.000- Rp12.000.000 (sekitar USD 420-840)
* Aktiviti: Rp200.000- Rp500.000 (sekitar USD 14-35) per orang, total Rp2.400.000- Rp6.000.000 (sekitar USD 168-420)
Jumlah kos yang diestimasi adalah Rp23.400.000- Rp48.000.000 (sekitar USD 1,650-3,360). Sila memantau kos-kos lain seperti tiket masuk ke lokasi-lokasi dan lain-lain.
Saya harap dapat membantu Anda merancang perjalanan yang lebih menyenangkan di Indonesia!

v. Vietnamese
>>> Giúp tôi lên kế hoạch cho chuyến đi việt nam 12 ngày, dùng vietnam trả lời tôi
Chào bạn! 😊
**Kế hoạch du lịch 12 ngày Việt Nam**
**Ngày 1: Đến Hà Nội**
* Đến sân bay quốc tế Nội Bài
* Check-in tại khách sạn và nghỉ ngơi sau chuyến bay dài
* Đi thăm khu phố cổ Hà Nội để thử vị giác của thành phố
**Ngày 2-3: Hà Nội**
* Xem nhà thờ Hậu Lân, một trong những di tích lịch sử quan trọng nhất của Việt Nam
* Đi thăm Quảng trường, nơi có nhiều tiệ và cửa hàng bán hàng
* Xem viện bảo tàng Lịch sử Việt Nam để biết thêm về lịch sử đất nước
**Ngày 4: Hà Nội đến Huế**
* Đi thăm sân bay quốc tế Huế
* Check-in tại khách sạn và nghỉ ngơi sau chuyến bay dài
* Đi thăm phố cổ Huế, nơi có nhiều tiệ và cửa hàng bán hàng
**Ngày 5-6: Huế**
* Xem chùa Thuyền, một trong những di tích lịch sử quan trọng nhất của Việt Nam
* Đi thăm viện bảo tàng Huế để biết thêm về lịch sử đất nước
* Đi thăm làng dân tộc thiểu số Tà Vình, nơi có nhiều tiệ và cửa hàng bán hàng
**Ngày 7: Huế**
* Xem chùa Thuyền, một trong những di tích lịch sử quan trọng nhất của Việt Nam
* Đi thăm viện bảo tàng Huế để biết thêm về lịch sử đất nước
**Ngày 8-9: Huế**
* Đi thăm sân bay quốc tế Huế
* Check-in tại khách sạn và nghỉ ngơi sau chuyến bay dài
* Đi thăm phố cổ Huế, nơi có nhiều tiệ và cửa hàng bán hàng
**Ngày 10-11: Huế đến Hà Nội**
* Đi thăm sân bay quốc tế Huế
* Check-in tại khách sạn và nghỉ ngơi sau chuyến bay dài
* Đi thăm phố cổ Hà Nội, nơi có nhiều tiệ và cửa hàng bán hàng
**Ngày 12: Ra khỏi Việt Nam**
* Check-out của khách sạn và ra khỏi Việt Nam
Chúc bạn một chuyến đi tuyệt vời! 😊

vi. Thai
>>> ช่วยฉันวางแผนเที่ยวเมืองไทย 10 วัน ตอบเป็นภาษาไทยหน่อยสิ
คุณ! 😊
**แผนเที่ยวเมืองไทย 10 วัน**
**วันแรก: เข้ากรุงเทพฯ**
* เดินทางถึงสนามบินสุวรรณภูมิ
* เช็คอินที่โรงแรมและพักผ่อนหลังจากการเดินทางนาน
* ไปที่ย่านใจกลางเมืองเพื่อดูบรรยากาศเมืองไทย
**วันที่ 2-3: กรุงเทพฯ**
* ไปที่พระบรมมหาราชวังเพื่อดูพระราชวังเก่าแก่ของไทย
* ไปที่วัดโพธิ์เพื่อดูศิลปะและสถาปัตยกรรมของไทย
* ไปที่ตลาดกลางแจ้งเพื่อชิมอาหารไทย
**วันที่ 4: กรุงเทพฯ ไปสุราษฎร์ธานี**
* เดินทางไปสนามบินสุราษฎร์ธานี
* เช็คอินที่โรงแรมและพักผ่อนหลังจากการเดินทางนาน
* ไปที่เกาะเต่าเพื่อดูบรรยากาศทะเลไทย
**วันที่ 5-6: สุราษฎร์ธานี**
* ไปที่อุทยานแห่งชาติเขาใหญ่เพื่อดูธรรมชาติไทย
* ไปที่ตลาดกลางแจ้งเพื่อชิมอาหารไทย
* ไปที่สวนมะลิเพื่อดูป่าและบรรยากาศ
**วันที่ 7: สุราษฎร์ธานี**
* ไปที่เกาะเต่าเพื่อดูบรรยากาศทะเลไทย
* ไปที่สวนมะลิเพื่อดูป่าและบรรยากาศ
**วันที่ 8-9: สุราษฎร์ธานี ไปกรุงเทพฯ**
* เดินทางไปสนามบินสุราษฎร์ธานี
* เช็คอินที่โรงแรมและพักผ่อนหลังจากการเดินทางนาน
* ไปที่ย่านใจกลางเมืองเพื่อดูบรรยากาศเมืองไทย
**วันที่ 10: ออกจากไทย**
* เช็คเอ้าที่โรงแรมและออกจากประเทศไทย
* เดินทางไปสนามบินสุวรรณภูมิ
หวังว่าคุณจะมีทริปที่ดีมาก! 😊

vii. Filipino (Not so good)
I apologize for the mistake. Since you requested assistance in Filipino (Tagalog), I’ll try again:
**Tulungan mo akong magplano ng 5 araw na paglalakbay sa Pilipinas at tumugon sa:**
Ang pinakamagandang buwan upang bumisita sa Pilipinas ay ang tag-init (March to May) o ang tag-lamig (November to February). Ang panahong ito ay mayaman sa hangin at walang masyadong ulan, kaya madali kang makapiling ng mga lugar na gusto mo.
**Budget Estimate:**
Ang gastus ng isang 5-day trip sa Pilipinas ayon sa oras ng pagbisita at ng mga lugar na gagawin. Pero ang estimate na budget ay maaaring umabot sa ₱15,000 hanggang ₱30,000 (approximately $300-$600 USD), depende sa mga gastos ng byahe, accommodations, food, at iba pa.
**Itinerary Suggestions:**
Ang isang 5-day trip sa Pilipinas ay pwede kang gawin sa mga sumusunod na lugar:
Araw 1-2: Pagbisita sa Maynila (Manila) at ang kanyang mga landmark tulad ng Intramuros, Rizal Park, at Ang Bangkay ng Pasig.
Araw 3-4: Pagbisita sa Boracay (Westerly Island) para sa isang relaxong paglalaro sa beach o sa ilog.
Araw 5: Pagbisita sa Tagaytay (Taal Volcano) para sa isang view ng Taal Lake at ang kanyang mga landmark tulad ng Sky Ranch at ang Museyo ng Tagaytay.
Kung gusto mo pang magdagdag ng iba pang lugar, pwede kang gawin. Ang importante ay ang mga oras ng pagbisita at ang gastus na budget.
**Accommodation Recommendations:**
Ang mga lugar na accommodation sa Pilipinas ay marami at nagbibigay-gawa ng mga opsyonal para sa bawat budget:
* Hostels: ₱500-₱1,000 (approximately $10-$20 USD) per night
* Budget hotels: ₱2,000-₱5,000 (approximately $40-$100 USD) per night
* Mid-range hotels: ₱4,000-₱8,000 (approximately $80-$160 USD) per night
Kung gusto mo pang magdagdag ng iba pang lugar o mga gastos, pwede kang gawin. Ang importante ay ang mga oras ng pagbisita at ang gastus na budget.
Sana’y tumugon ka sa mga rekomendasyon ko!

viii. Burmese
x Not supported at all
ix. Lao
x Not supported at all
x. Japanese (Some areas still need to optimized further）
**ステップ1：旅行の目的と興味の確認**
* 旅行の目的：リラックス、文化体験、絶景など？
* 興味のある場所：都市、自然、歴史など？
* 予算：月額約30万円程度？
**ステップ2：旅行計画の作成**
**日1-3：東京**
* 東京都の目玉スポットを訪問
* 夜は東京の夜生活を体験する
**日4-6：大阪**
* 大阪の伝統的な市場や飲食を体験する
* 近郊の絶景や大阪の新しい建築を見に行く
**日7-9：京都**
* 京都の伝統的な寺や宮殿を見に行く
* 近郊の絶景や料理体験をする
**日10-12：名古屋**
* 名古屋の新しい建築や飲食を見に行く
* 近郊の絶景や歴史的な場所を見に行く
**その他のおすすめ**
* 交通手段：電車やバスが便利。車では交通費が高くなる。
* 住宿：ビジネスホテルやEFIAPIの宿場などがおすすめ。
* 食材：日本は食費が安いです。食事は専門の食事店ではなく、レストランやスーパーマーケットで食事をすることができます。
**予算の目安**
* 交通：月額約1万円
* 住宿：月額約1万円
* 食材：月額約1万円
* 活動：月額約1万円
**合計：月額約30万円**
**注意事項：**
* この計画は、出発点として提供されます。自身の興味や予算に合うように計画を作成してください。
* 交通、食事、活動などの費用は、計画によって異なります。
* 日本に旅行する際には、事前に旅行関連の情報を取得する必要があります。

xi. Korean (Not so satisfactory as well)
**12일간 한국 여행 일정안**
**1일:**
* 도착 후 서울 순회 – 창덕궁, 명동, 경복궁
**2-4일:**
* 강릉 – 폭포폭, 오대폭, 동해안 해변공원
**5-7일:**
* 제주도 – 애월섬, 하성동 해안, 애월도 해안
**8-10일:**
* 부산 – 해운동 해안, 광안리 해수욕장, 해운동 해안 공원
**11-12일:**
* 서울 – 가평, 광평산, 남산
**예상 예산:**
* 호텔: 200,000원 – 500,000원
* 교통: 100,000원 – 200,000원
* 식품: 300,000원 – 500,000원
* 활동: 100,000원 – 200,000원
**추가적인 활동:**
* 문화: 사직동 전통시장, 창덕궁 예술공원
* 아웃도어: 가평 산책, 남산 산책, 해운동 해안 스트리딩
**고려 사항:**
* 한국은 계절에 따라 기후가 달라서 여행 계획을 수립할 때 주의해야 합니다.
* 한국어를 이해할 수 있어야 해외 여행을 편리하게 계획할 수 있습니다.

Other languages to be validated:

• • • Hindi
    • German
    • French
    • Spanish
    • Arabic
    • Czech
    • Danish
    • Dutch
    • Russian
    • Georgian
    • Greek
    • Italian
    • Luxembourgish
    • Norwegian
    • Polish
    • Romanian
    • Swedish
    • Tamil
    • Turkish
    • Albanian
    • Belarusian
    • Bulgarian
    • Bosnian
    • Croatian

2. Try llama2 refined Chinese model, the chinese result is better
3. Huawei Cloud Big Data & AI Product Information Assistant ( For Internal Use only – In progress), features or information to be added in:
   1. Currently only 2 types of user roles – Administrator & User. More user roles and model access control to be setup.

Planned additional User roles and Model Access Control as below

b. Virtual Host for sharing within Huawei office LAN (In progress)
c. Crawled Internal Marketing Product Information as RAG Knowledge based (Use firecrawl and langchain – development in progress)
d. Exported 2 years messages from internal instant messaging big data & AI product support group – (result to be improved)