Sorry your browser is not supported!

You are using an outdated browser that does not support modern web technologies, in order to use this site please update to a new browser.

Browsers supported include Chrome, FireFox, Safari, Opera, Internet Explorer 10+ or Microsoft Edge.

AppGameKit/AppGameKit Studio Showcase / [WIP] Tiled importer v.2

Author
Message
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 3rd Mar 2017 19:34 Edited at: 2nd Apr 2017 04:05
Link
My old thread has long since been locked, https://forum.thegamecreators.com/thread/210176

Clonkex and I have gone back and forth over the years implementing this. I'm revisiting the project to update it so it works with AppGameKit 2. With UDTs now supporting dynamic arrays, I can contain the entire map and it's data into a single variable. This helps keep things cleaner and also should theoretically allow you load multiple maps at a time (if for some reason you needed to).

I'm almost caught up with everything that the old version had, which I should finish up today. I did add support for external tilesets finally. My biggest concern right now is speed. CSV appears the best method right now. The Base64 is extremely slow with large maps. It took close to 4 minutes to decode the string from my zelda map, which was a 120k character encoded string. I've tried using memblocks and gained practically no speed increase. I have one more idea to try though.

Image and Object layers are trivial and will be added shortly. I also plan to implement properties (finally) and animations.

Sorry, no pics yet, wouldn't be much of anything to show really. If anyone has suggestions or a request for something that was missing in my earlier versions, shout it out.


Features:
Supports encoding: xml, csv, base64(uncompressed)
Supported map types: orthogonal, isometric, staggered isometric, hexagonal
Supports tileset images which use margin/spacing
Supports image layers
Layer alpha and visibility
Set the map viewport area (Define area of screen where map can only be visible)
Supports tile flipping
Support for TSX tilesets (external tileset xml)
Compression (gzip, zlib)
Objects
Properties
Animations
Terrain
Image Collections
Tile render order


Update: 1 Apr 2017
* Fixed tile selection for isometric maps
* Fixed tile position/layout for staggered maps

Update: 24 Mar 2017
* Objects fully supported

Update: 23 Mar 2017
* Objects is partially supported (rectangle, ellipse, polygon)
* Fixed a bug in the xml parser
* worked out some issues with layer offsets

Update: 20 Mar 2017
* Add support for image collections (which I didn't know existed until today)

Update: 19 Mar 2017
* Added animated tiles

Update: 18 Mar 2017
* Added properties
* Restructured how layers are handled
* Added image layers

Update: 15 Mar 2017
* Added hexagonal support, but still need to work out rendering order for some of the various configurations

Update: 4 Mar 2017
* Base64 has been redesigned and now is significantly faster (about 1000x faster)
* After much headache, the XML parser has been rewritten from scratch for a huge speed boost (up to 50x faster)

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
RickV
TGC Development Director
24
Years of Service
User Offline
Joined: 27th Apr 2000
Location: United Kingdom
Posted: 5th Mar 2017 08:33
Link
Hi Phaelax,

This is great. Let me know when you have it working, I'd like to try it out.

Rick
Development Director
TGC Team
Back to top
Profile PM Email Website
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 10th Mar 2017 18:34 Edited at: 10th Mar 2017 18:34
Link
Here's a download you can test with for now. The video shows a quick demo map I made, 32x32 tiles with 3 layers. That's 3072 tiles, loaded in under 200ms. It's encoded with base64, no compression. For large maps, I highly discourage the raw plain xml format.




"I like offending people, because I think people who get offended should be offended." - Linus Torvalds

Attachments

Login to view attachments
Back to top
Profile PM Email Website
SpecTre
Developer
21
Years of Service
User Offline
Joined: 24th Feb 2003
Location: UK
Posted: 10th Mar 2017 19:17
Link
Phaelax this is very good work, the loading looks very fast too. Cool
The Amiga and Amos were great!
Back to top
Profile PM Email Website
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 15th Mar 2017 22:59
Link
I updated Tiled the other day and boy was I out of date! When did they add hexagonal maps? Well alrighty then, I've got that added now!

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds

Attachments

Login to view attachments
Back to top
Profile PM Email Website
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 18th Mar 2017 18:49 Edited at: 18th Mar 2017 18:55
Link
So unless someone can give me a good reason to implement terrain types, I see no reason for it. As far as I can tell, it's nothing that would be used in the display of the render map and more to do so with the editing in Tiled. But I could be wrong about that.

I've finished adding image layers and have restructured the layer format slightly. Tiled layers, image layers, and eventually object layers, are all of one 'type'. For the various functions a user made need to call on a map, the type of map loaded does not change the command needed. A single function (such as positionMap) encapsulates the headaches for you.

Properties has also been added for map, layers, and tilesets. A note about how properties are stored, they are stored in a simple key-value array with values stored as strings. Though the TMX format has a type attribute to define what type of data is being represented, I found it easier to leave them as strings and let the user decide what/how to convert them. Since the user likely won't be accessing property values in a map without already knowing what they are. And I can't store different data types into the same array.

Object layers will be next on my to-do list and then I'll tackle animations.

Here's what I find to be the best format to use in your Tiled maps, from fastest to sloweset:
1. Base64 (uncompressed)
2. CSV
3. XML

XML is about twice as slow as any of the others, and grows exponentially as the map size increases. CSV is ok for smaller maps, but after you get to a certain size, and with multiple layers, it too can become slow to load. The slowdowns are due to the fact that XML and CSV are all stored textually. Even though Base64 is a string, it's a single string that represents an entire layer of data. A simple command can very quickly throw this string into a memblock, thus all calculations at that point are just bytes. This eliminates the slowest part of the loading process, which is string parsing.

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 20th Mar 2017 02:08
Link
Ok, so I skipped object layers and went right to animation. Grabbed an animated hexagonal sprite I found in some random forum and made a quick sprite sheet and built an animation sequence. My initial tests, as seen in the video, are working perfectly. I have not yet tested it on a large map with multiple animations. This test was a small 24x24 map with 2 layers, 2 tilesets, and 2 animations. I've structured it as efficiently as I could see how to. Only those tiles with animations will be in the animation loops. The tradeoff? A separate array contains a list of those sprites that need to be managed, which means more memory used. When I'm finished with this, I'd like to get some folks to test this out on mobile devices because memory usage means almost nothing on a PC.



"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
pjsmith67
8
Years of Service
User Offline
Joined: 2nd Feb 2016
Location: Nebraska, USA
Posted: 20th Mar 2017 15:47
Link
I tried using the TMX Importer last night and kept getting an error. I created a simple orthogonal map, 43x24 and filled it with one tile.

The error I'm getting is "Array index out of bounds, index: -1, Array Length 10 in xml_dom_parser.agc at line 163,"

Any idea off the top of your head? I've attached the tmx file I'm using. Your sample tmx file works, though.
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 20th Mar 2017 18:46
Link
I don't see any attachment. Did the file use compression? I've been making small corrections to my xml code as I go along, those array errors being the most common. It's possible I've already fixed it. I'll try to post an updated code tonight.

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
pjsmith67
8
Years of Service
User Offline
Joined: 2nd Feb 2016
Location: Nebraska, USA
Posted: 20th Mar 2017 20:16
Link
oops. lets try this again. Here's the attachment. Thanks!

Attachments

Login to view attachments
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 20th Mar 2017 20:48
Link
I don't think this is related to the error you got, but the image path might cause an issue. I don't think AppGameKit can access a file directly from outside of it's project folder. I would change that so the TMX and image file are in the same directory (the media folder).

And could you post the panel.png image please.

Your format is slightly different that what I've worked with. Generally, I'd see an image tag as a direct descendant of tileset. In yours, I see TILE inside the TILESET, which then includes IMAGE. Generally, I had only animations inside a tile within a tileset, so I'm going to have to check the documentation.

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
pjsmith67
8
Years of Service
User Offline
Joined: 2nd Feb 2016
Location: Nebraska, USA
Posted: 20th Mar 2017 21:13
Link
Here's panel.png. Sorry, forgot about the image file.

Hmmm... ok, didn't think about that when i created the file. Let me start over with a fresh map and see what happens.

Attachments

Login to view attachments
Back to top
Profile PM
pjsmith67
8
Years of Service
User Offline
Joined: 2nd Feb 2016
Location: Nebraska, USA
Posted: 20th Mar 2017 21:27
Link
Ok, I took your grassland_tiles example, added a collection of tiles and put a singe image in there. Saved it and tried tmx_importer and got the the same error.

So, it doesn't like it when you us a collection of files for a tile set.
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 20th Mar 2017 22:11 Edited at: 20th Mar 2017 23:29
Link
Apparently, Tiled has a feature I was unaware of. The format documentation really doesn't say anything about image collections either. http://doc.mapeditor.org/reference/tmx-map-format/
I think I understand how they work, but I'll have to think about how to implement it.

Googling it has only shown me posts from several development forums (for various projects) of people asking how to add support for image collections. It must be something they threw in and never told anyone about because it appears to me that many implementations are missing it.

The most frustrating thing about Tiled's XML format is the fact that some things start at 1 while others are based at 0. It's very infuriating!

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 21st Mar 2017 01:44
Link
pjsmith67, try this code. Your map *should* work now. And it was a pain in the butt. The only thing that might appear off is the depth of tiles. I haven't gone through and set up the different render orders yet.

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds

Attachments

Login to view attachments
Back to top
Profile PM Email Website
pjsmith67
8
Years of Service
User Offline
Joined: 2nd Feb 2016
Location: Nebraska, USA
Posted: 21st Mar 2017 02:43
Link
Yep, that worked. Thanks!

Now, about object layers...

Just kidding... you're doing great work so far and it is appreciated.

Phil
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 24th Mar 2017 16:18
Link
Objects have now been added

The shapes are drawn using 2D commands, so they'll always draw on top regardless of layer order. My plan is to hopefully draw the shape once to an image and turn them into sprites, but that's not an immediate concern of mine as I don't think objects were ever intended to actually be part of the map visually.

I have a few more functions to write, mainly get/set functions, then I'll release the final code for everyone to test.

I still haven't tackled terrain types yet.

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
FPSGuy21
8
Years of Service
User Offline
Joined: 30th Sep 2016
Location:
Posted: 30th Mar 2017 22:55
Link
Hey Phaelax,

what about releasing your code on github so everyone can contribute? looking forward to the final code version. Thanks for your work I really appreciate it!
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 2nd Apr 2017 04:09
Link
Staggered maps weren't fully supported until now. Tiled lets you set a few different parameters which can change the layout of staggered maps (stagger axis, stagger index). I was hoping to post the code finally tonight, but I already spent too much time tonight on fixing the isometric tile selection that I haven't finished staggered selection (which is a bit tricky). Maybe tomorrow, depending on how long this problem takes me.

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
GarBenjamin
AGK Developer
7
Years of Service
User Offline
Joined: 30th Nov 2016
Location: USA
Posted: 14th Jun 2017 17:06
Link
This is awesome! Don't understand why you are just giving it away for free (used to Unity where it seems like everything anybody makes immediately goes to asset store for sale). This would be worth something because it is very useful.

Anyway thanks for tackling it!
TI/994a (BASIC) -> C64 (BASIC/PASCAL/ASM/Others) -> Amiga (AMOS/BLITZ/ASM/C/Gamesmith) -> DOS (C/C++/Allegro) -> Windows (C++/C#/Monkey X/GL Basic/Unity/Others)
Back to top
Profile PM
LeGugusse
17
Years of Service
User Offline
Joined: 15th Feb 2007
Location: Paris - France
Posted: 5th Jul 2017 11:52
Link

Thank you so much!!
That's amazing!
Cry \"Havoc!\" and let slip the dogs of war
Back to top
Profile PM
LeGugusse
17
Years of Service
User Offline
Joined: 15th Feb 2007
Location: Paris - France
Posted: 5th Jul 2017 12:29
Link

By the way... Someone whould guess the code for the functions:

tmx_GetIsoTileX(map, tile) and tmx_GetIsoTileY(map, tile) ?

assuming that the GetOrthoTileX is :

function tmx_GetOrthoTileX(map as TMX_Map, tile as integer)
y = tile / map.width
x = tile - map.width * y
endfunction x

Not implemented yet...
Cry \"Havoc!\" and let slip the dogs of war
Back to top
Profile PM
LeGugusse
17
Years of Service
User Offline
Joined: 15th Feb 2007
Location: Paris - France
Posted: 5th Jul 2017 12:45
Link
This seems to work:



function tmx_getIsoTileX(map ref as TMX_Map, tile as integer)

x = trunc(tile / map.height)

endfunction X

function tmx_getIsoTileY(map ref as TMX_Map, tile as integer)

x = trunc(tile / map.height)
y = tile - (X* map.width)

endfunction Y
Cry \"Havoc!\" and let slip the dogs of war
Back to top
Profile PM
SmileSlime
7
Years of Service
User Offline
Joined: 10th May 2017
Location:
Posted: 21st Aug 2017 12:11
Link
How do I assign collisions to the tiles I make?
Back to top
Profile PM
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 18th Aug 2018 01:43
Link
The non-stop rain lately has given me a little time to revisit this project today. As requested, I'm working on a help file and documentation to help folks use the library.

Quote: "tmx_getIsoTileX"


Those functions should not be accessed by the user and instead should be using tmx_getMapTile(map, x, y). This function encapsulates all the map formats so you don't need to worry about if the map is isometric, orthogonal, etc...

Still have many commands to add to the documentation, but I'm posting what I have tonight to let folks take a look and possibly get some feedback. If something isn't clear let me know. Also, while many features have been implemented and are supported, I haven't yet written the functions to actually access them yet. Such as objects and properties. I know they're implemented because in this thread I said so But it's been a year since I've worked on this so I need to study my code a little bit and figure out where I am.
Tiled TMX Importer V.2
XML Parser V.2
Base64 Encoder/Decoder
Purple Token - Free online hi-score database
Legend of Zelda

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds

Attachments

Login to view attachments
Back to top
Profile PM Email Website
Phaelax
DBPro Master
21
Years of Service
User Offline
Joined: 16th Apr 2003
Location: Metropia
Posted: 18th Aug 2018 16:12
Link
I don't suppose anyone has the version of code which supports objects? I thought I was looking at my most recent copy of code but there is nothing in it showing objects have been supported.
Tiled TMX Importer V.2
XML Parser V.2
Base64 Encoder/Decoder
Purple Token - Free online hi-score database
Legend of Zelda

"I like offending people, because I think people who get offended should be offended." - Linus Torvalds
Back to top
Profile PM Email Website
Cliff Mellangard 3DEGS
Developer
18
Years of Service
User Offline
Joined: 20th Feb 2006
Location: Sweden
Posted: 18th Aug 2018 22:11
Link
Sorry i never had the time to download or test this .
I Always use backups on cheap usb flash today where i have the date of backup in the zip…
I dont know how many times i either mess my code up or simply deletes and Thinks i have backed it up
I almost destroyed the entire code for my latest yesterday but managed to save it by undo every file and that where painfull.
My space on goggle play ... https://play.google.com/store/apps/developer?id=Play8Bitar+Osterlen
Play8Bitars channel ... https://www.youtube.com/channel/UC_TbzZmDzj0axBZsbfRnDCQ
Think i know it channel ... https://www.youtube.com/channel/UCEJY7tJ5_HBQxi06BGsnoQg
SlideDb space ... http://www.slidedb.com/members/play8bitars-osterlen
Back to top
Profile PM Website
Icerion
6
Years of Service
User Offline
Joined: 3rd Aug 2018
Location:
Posted: 30th Aug 2018 16:21
Link
Can you please add support for terrains?

Thanks!
Back to top
Profile PM
Back to top

Login to post a reply

Server time is: 2024-11-23 12:58:31
Your offset time is: 2024-11-23 12:58:31